Started by upstream project "osmo-gsm-tester_build-osmo-ggsn" build number 6676 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6671 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17648 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7501 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6676 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8695 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8940 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2940 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29250 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5148 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30027 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4672 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12961 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9235 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4692 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8032 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5187 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5528 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3905 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins5124132587527282835.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-08 21:44:12 + trial_dir_prefix=trial- + rm -rf trial-2349 trial-2349-bin.tgz trial-2349-run.tgz + trial_dir=trial-2350 + mkdir -p trial-2350 + mv open5gs.build-8.tgz osmo-bsc.build-17648.tgz osmo-bts-oc2g.build-5528.tgz osmo-bts-sysmo.build-8032.tgz osmo-bts.build-7501.tgz osmo-ggsn.build-6676.tgz osmo-hlr.build-8695.tgz osmo-hnbgw.build-2940.tgz osmo-mgw.build-8940.tgz osmo-msc.build-29250.tgz osmo-nitb.build-12961.tgz osmo-pcu-oc2g.build-3905.tgz osmo-pcu-sysmo.build-5187.tgz osmo-pcu.build-5148.tgz osmo-sgsn.build-30027.tgz osmo-stp.build-9235.tgz osmo-trx.build-4672.tgz osmocom-bb.build-4692.tgz srslte.build-19.tgz trial-2350 + cat open5gs.build-8.md5 osmo-bsc.build-17648.md5 osmo-bts-oc2g.build-5528.md5 osmo-bts-sysmo.build-8032.md5 osmo-bts.build-7501.md5 osmo-ggsn.build-6676.md5 osmo-hlr.build-8695.md5 osmo-hnbgw.build-2940.md5 osmo-mgw.build-8940.md5 osmo-msc.build-29250.md5 osmo-nitb.build-12961.md5 osmo-pcu-oc2g.build-3905.md5 osmo-pcu-sysmo.build-5187.md5 osmo-pcu.build-5148.md5 osmo-sgsn.build-30027.md5 osmo-stp.build-9235.md5 osmo-trx.build-4672.md5 osmocom-bb.build-4692.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17648.md5 osmo-bts-oc2g.build-5528.md5 osmo-bts-sysmo.build-8032.md5 osmo-bts.build-7501.md5 osmo-ggsn.build-6676.md5 osmo-hlr.build-8695.md5 osmo-hnbgw.build-2940.md5 osmo-mgw.build-8940.md5 osmo-msc.build-29250.md5 osmo-nitb.build-12961.md5 osmo-pcu-oc2g.build-3905.md5 osmo-pcu-sysmo.build-5187.md5 osmo-pcu.build-5148.md5 osmo-sgsn.build-30027.md5 osmo-stp.build-9235.md5 osmo-trx.build-4672.md5 osmocom-bb.build-4692.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2350 combinations: None trial: 'trial-2350' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2350 -------------------------------------------------------------------------------------------- 21:44:24.605146 tst trial-2350: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/log --------------------------------------------------------------------- trial-2350 nitb_sms:sysmo --------------------------------------------------------------------- 21:46:31.053959 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:46:31.058484 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 21:46:31.081580 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 21:46:31.091366 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 21:46:31.146677 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 21:46:31.168419 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 21:46:31.176853 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 21:46:31.725434 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 21:46:31.734210 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 21:46:31.749856 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 21:46:32.159309 tst mo_mt_sms.py: using LAC 16954 21:46:32.405928 tst mo_mt_sms.py: using RAC 124 21:46:32.528737 tst mo_mt_sms.py: using CellId 16954 21:46:32.641485 tst mo_mt_sms.py: using BVCI 16955 21:46:32.748239 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 21:46:32.926594 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 21:46:33.039758 tst mo_mt_sms.py:9: start nitb and bts... 21:46:33.237181 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:46:35.467532 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17586): Launched 21:46:35.764415 run osmo-nitb_10.42.42.2(pid=17587): Launched 21:46:35.926896 run osmo-nitb_10.42.42.2(pid=17587): ERR: Terminated: ERROR {rc=2} [trial-2350↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17587)] 21:46:36.049246 run osmo-nitb_10.42.42.2(pid=17587): stdout: | (launched: 2022-12-08_21:46:35.710383) 21:46:36.173411 run osmo-nitb_10.42.42.2(pid=17587): stderr: | (launched: 2022-12-08_21:46:35.754685) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:46:36.297881 run osmo-nitb_10.42.42.2(pid=17587): stdout: | (launched: 2022-12-08_21:46:35.710383) 21:46:36.416358 run osmo-nitb_10.42.42.2(pid=17587): stderr: | (launched: 2022-12-08_21:46:35.754685) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:46:36.558457 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=17587): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17587) [trial-2350↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17587)] [trial-2350↪nitb_sms:sysmo↪mo_mt_sms.py:11] 21:46:36.566576 tst mo_mt_sms.py:11: Test FAILED (4.8 sec) 21:46:36.572997 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17586): Terminating (SIGTERM) 21:46:36.782135 --- ParallelTerminationStrategy: PID 17586 died... 21:46:36.803266 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17586): Terminated: ok {rc=0} 21:46:36.888511 bus /sierra_3: Setting Powered False 21:46:37.987646 bus /sierra_3: Setting Powered False 21:46:39.106982 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 sms:sysmo --------------------------------------------------------------------- 21:46:40.290208 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:46:40.294435 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 21:46:40.315180 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 21:46:40.342126 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 21:46:40.394395 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 21:46:40.415045 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 21:46:40.440866 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 21:46:40.985750 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 sms:sysmo mo_mt_sms.py ---------------------------------------------- 21:46:40.990597 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 21:46:41.000902 tst sms:sysmo: Using 1 x bts (candidates: 1) 21:46:41.033617 tst mo_mt_sms.py: using LAC 16955 21:46:41.153060 tst mo_mt_sms.py: using RAC 125 21:46:41.271623 tst mo_mt_sms.py: using CellId 16955 21:46:41.389745 tst mo_mt_sms.py: using BVCI 16956 21:46:41.496557 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 21:46:41.507046 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 21:46:41.517410 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 21:46:41.527685 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 21:46:41.538029 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 21:46:41.548235 tst sms:sysmo: Using 1 x modem (candidates: 2) 21:46:41.665344 tst sms:sysmo: Using 1 x modem (candidates: 2) 21:46:41.784591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:46:43.531680 run create_hlr_db(pid=17593): Launched 21:46:43.653910 bus /sierra_2: Setting Powered False 21:46:44.716878 run create_hlr_db(pid=17593): Terminated: ok {rc=0} 21:46:45.145580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17595): Launched 21:46:45.446282 run osmo-hlr_10.42.42.2(pid=17596): Launched 21:46:45.560181 run osmo-stp_10.42.42.5: Starting osmo-stp 21:46:48.047040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17598): Launched 21:46:48.344558 run osmo-stp_10.42.42.5(pid=17599): Launched 21:46:48.458142 run osmo-msc_10.42.42.6: Starting osmo-msc 21:46:53.704580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17601): Launched 21:46:54.001827 run osmo-msc_10.42.42.6(pid=17602): Launched 21:46:54.181793 run osmo-stp_10.42.42.5(pid=17599): ERR: Terminated: ERROR {rc=1} [trial-2350↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17599)] 21:46:54.318552 run osmo-stp_10.42.42.5(pid=17599): stdout: | (launched: 2022-12-08_21:46:48.289975) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:46:54.455513 run osmo-stp_10.42.42.5(pid=17599): stderr: | 20221208214648462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214648462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214648462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214648463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214648463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214648463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214648463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:46:54.593212 run osmo-stp_10.42.42.5(pid=17599): stdout: | (launched: 2022-12-08_21:46:48.289975) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:46:54.720567 run osmo-stp_10.42.42.5(pid=17599): stderr: | 20221208214648462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214648462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214648462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214648463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214648463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214648463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214648463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:46:54.872810 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=17599): Process ended prematurely: osmo-stp_10.42.42.5(pid=17599) [trial-2350↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17599)] [trial-2350↪sms:sysmo↪mo_mt_sms.py:16] 21:46:54.881969 tst mo_mt_sms.py:16: Test FAILED (13.9 sec) 21:46:54.910457 run osmo-hlr_10.42.42.2(pid=17596): ERR: Terminated: ERROR {rc=237} [trial-2350↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17596)] 21:46:54.962413 run osmo-hlr_10.42.42.2(pid=17596): stdout: | (launched: 2022-12-08_21:46:45.391704) 21:46:55.016586 run osmo-hlr_10.42.42.2(pid=17596): stderr: | 20221208214645569 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208214645569 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208214645569 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208214645569 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208214645569 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208214645569 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208214645586 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208214645596 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208214645596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208214645596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:46:55.090741 run osmo-msc_10.42.42.6(pid=17602): ERR: Terminated: ERROR {rc=2} [trial-2350↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17602)] 21:46:55.142614 run osmo-msc_10.42.42.6(pid=17602): stdout: | (launched: 2022-12-08_21:46:53.946888) 21:46:55.196129 run osmo-msc_10.42.42.6(pid=17602): stderr: | 20221208214654262 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208214654262 DLGLOBAL DEBUG validating counter group 0x7ff29e5e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208214654262 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208214654262 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208214654262 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208214654262 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208214654264 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208214654264 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208214654265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208214654265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:46:55.250802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17595): Terminating (SIGTERM) 21:46:55.294212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17598): Terminating (SIGTERM) 21:46:55.337796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17601): Terminating (SIGTERM) 21:46:55.381811 --- ParallelTerminationStrategy: PID 17595 died... 21:46:55.402267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17595): Terminated: ok {rc=0} 21:46:55.450809 --- ParallelTerminationStrategy: PID 17598 died... 21:46:55.471224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17598): Terminated: ok {rc=0} 21:46:55.519749 --- ParallelTerminationStrategy: PID 17601 died... 21:46:55.539994 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17601): Terminated: ok {rc=0} 21:46:55.631187 bus /sierra_3: Setting Powered False 21:46:56.731589 bus /sierra_3: Setting Powered False 21:46:57.850340 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 nitb_ussd:sysmo --------------------------------------------------------------------- 21:46:59.125707 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:46:59.129190 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 21:46:59.149365 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 21:46:59.155956 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 21:46:59.189939 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 21:46:59.211611 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 21:46:59.218794 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 21:46:59.736276 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2350 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 21:46:59.741466 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 21:46:59.751871 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 21:46:59.784886 tst assert_extension.py: using LAC 16956 21:46:59.901290 tst assert_extension.py: using RAC 126 21:47:00.018418 tst assert_extension.py: using CellId 16956 21:47:00.136231 tst assert_extension.py: using BVCI 16957 21:47:00.244242 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 21:47:00.359157 tst assert_extension.py:10: start nitb and bts... 21:47:00.574106 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:47:01.260414 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17607): Launched 21:47:01.597360 run osmo-nitb_10.42.42.2(pid=17608): Launched 21:47:01.795682 run osmo-nitb_10.42.42.2(pid=17608): ERR: Terminated: ERROR {rc=2} [trial-2350↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17608)] 21:47:01.944588 run osmo-nitb_10.42.42.2(pid=17608): stdout: | (launched: 2022-12-08_21:47:01.534831) 21:47:02.093700 run osmo-nitb_10.42.42.2(pid=17608): stderr: | (launched: 2022-12-08_21:47:01.582922) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:47:02.241648 run osmo-nitb_10.42.42.2(pid=17608): stdout: | (launched: 2022-12-08_21:47:01.534831) 21:47:02.383316 run osmo-nitb_10.42.42.2(pid=17608): stderr: | (launched: 2022-12-08_21:47:01.582922) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3c9519268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=17608): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17608) [trial-2350↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17608)] 21:47:02.737707 tst osmo-nitb_10.42.42.2(pid=17608): stdout: | (launched: 2022-12-08_21:47:01.534831) 21:47:02.866903 tst osmo-nitb_10.42.42.2(pid=17608): stderr: | (launched: 2022-12-08_21:47:01.582922) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:47:03.019329 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=17608): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17608) [trial-2350↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17608)] [trial-2350↪nitb_ussd:sysmo↪assert_extension.py:12] 21:47:03.028389 tst assert_extension.py:12: Test FAILED (3.3 sec) 21:47:03.035509 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17607): Terminating (SIGTERM) 21:47:03.249326 --- ParallelTerminationStrategy: PID 17607 died... 21:47:03.270723 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17607): Terminated: ok {rc=0} 21:47:03.361731 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 ussd:sysmo --------------------------------------------------------------------- 21:47:04.569709 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:47:04.575099 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 21:47:04.597834 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 21:47:04.625833 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 21:47:04.663550 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 21:47:04.684930 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 21:47:04.711050 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 21:47:05.236113 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2350 ussd:sysmo assert_extension.py ---------------------------------------------- 21:47:05.241281 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 21:47:05.251636 tst ussd:sysmo: Using 1 x bts (candidates: 1) 21:47:05.284930 tst assert_extension.py: using LAC 16957 21:47:05.401746 tst assert_extension.py: using RAC 127 21:47:05.527501 tst assert_extension.py: using CellId 16957 21:47:05.645806 tst assert_extension.py: using BVCI 16958 21:47:05.755290 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 21:47:05.765930 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 21:47:05.776714 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 21:47:05.787294 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 21:47:05.797741 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 21:47:05.807941 tst ussd:sysmo: Using 1 x modem (candidates: 1) 21:47:05.924251 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:47:06.419600 run create_hlr_db(pid=17613): Launched 21:47:06.541544 bus /sierra_2: Setting Powered False 21:47:07.605193 run create_hlr_db(pid=17613): Terminated: ok {rc=0} 21:47:08.034493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17615): Launched 21:47:08.332350 run osmo-hlr_10.42.42.2(pid=17616): Launched 21:47:08.446600 run osmo-stp_10.42.42.5: Starting osmo-stp 21:47:08.962258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17618): Launched 21:47:09.260141 run osmo-stp_10.42.42.5(pid=17619): Launched 21:47:09.374054 run osmo-msc_10.42.42.6: Starting osmo-msc 21:47:09.911674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17621): Launched 21:47:10.210061 run osmo-msc_10.42.42.6(pid=17622): Launched 21:47:10.376284 run osmo-stp_10.42.42.5(pid=17619): ERR: Terminated: ERROR {rc=1} [trial-2350↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17619)] 21:47:10.503734 run osmo-stp_10.42.42.5(pid=17619): stdout: | (launched: 2022-12-08_21:47:09.205450) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:10.630548 run osmo-stp_10.42.42.5(pid=17619): stderr: | 20221208214709376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214709376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214709376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214709377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214709377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214709377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214709377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:10.755867 run osmo-stp_10.42.42.5(pid=17619): stdout: | (launched: 2022-12-08_21:47:09.205450) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:10.875100 run osmo-stp_10.42.42.5(pid=17619): stderr: | 20221208214709376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214709376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214709376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214709377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214709377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214709377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214709377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:11.017561 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=17619): Process ended prematurely: osmo-stp_10.42.42.5(pid=17619) [trial-2350↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17619)] [trial-2350↪ussd:sysmo↪assert_extension.py:17] 21:47:11.026069 tst assert_extension.py:17: Test FAILED (5.8 sec) 21:47:11.052413 run osmo-hlr_10.42.42.2(pid=17616): ERR: Terminated: ERROR {rc=237} [trial-2350↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17616)] 21:47:11.101516 run osmo-hlr_10.42.42.2(pid=17616): stdout: | (launched: 2022-12-08_21:47:08.277821) 21:47:11.152370 run osmo-hlr_10.42.42.2(pid=17616): stderr: | 20221208214708453 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208214708453 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208214708453 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208214708453 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208214708454 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208214708454 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208214708467 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208214708478 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208214708478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208214708478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:47:11.222841 run osmo-msc_10.42.42.6(pid=17622): ERR: Terminated: ERROR {rc=2} [trial-2350↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17622)] 21:47:11.271757 run osmo-msc_10.42.42.6(pid=17622): stdout: | (launched: 2022-12-08_21:47:10.155025) 21:47:11.322403 run osmo-msc_10.42.42.6(pid=17622): stderr: | 20221208214710427 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208214710428 DLGLOBAL DEBUG validating counter group 0x7f2bd218ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208214710428 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208214710428 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208214710428 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208214710428 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208214710430 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208214710430 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208214710430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208214710431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:47:11.373536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17615): Terminating (SIGTERM) 21:47:11.413991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17618): Terminating (SIGTERM) 21:47:11.454471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17621): Terminating (SIGTERM) 21:47:11.495306 --- ParallelTerminationStrategy: PID 17615 died... 21:47:11.514625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17615): Terminated: ok {rc=0} 21:47:11.559581 --- ParallelTerminationStrategy: PID 17618 died... 21:47:11.578666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17618): Terminated: ok {rc=0} 21:47:11.623725 --- ParallelTerminationStrategy: PID 17621 died... 21:47:11.642782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17621): Terminated: ok {rc=0} 21:47:11.729635 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 21:47:12.923318 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:47:12.929582 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 21:47:12.950385 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 21:47:12.977832 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 21:47:13.028643 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 21:47:13.049323 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 21:47:13.075935 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 21:47:13.624545 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 21:47:13.675722 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:13.686800 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:47:13.744069 tst mo_mt_call.py: using LAC 16958 21:47:13.865485 tst mo_mt_call.py: using RAC 128 21:47:13.987696 tst mo_mt_call.py: using CellId 16958 21:47:14.107408 tst mo_mt_call.py: using BVCI 16959 21:47:14.219301 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:14.230347 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:14.241154 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:14.251840 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:14.262631 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:14.273385 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:47:14.390155 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:47:14.508882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:47:15.012571 run create_hlr_db(pid=17628): Launched 21:47:15.137947 bus /sierra_2: Setting Powered False 21:47:16.211229 run create_hlr_db(pid=17628): Terminated: ok {rc=0} 21:47:16.678514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17630): Launched 21:47:17.026276 run osmo-hlr_10.42.42.2(pid=17631): Launched 21:47:17.200606 run osmo-stp_10.42.42.5: Starting osmo-stp 21:47:17.764303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17633): Launched 21:47:18.089340 run osmo-stp_10.42.42.5(pid=17634): Launched 21:47:18.212717 run osmo-msc_10.42.42.6: Starting osmo-msc 21:47:18.800225 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17636): Launched 21:47:19.125225 run osmo-msc_10.42.42.6(pid=17637): Launched 21:47:19.305926 run osmo-stp_10.42.42.5(pid=17634): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17634)] 21:47:19.444402 run osmo-stp_10.42.42.5(pid=17634): stdout: | (launched: 2022-12-08_21:47:18.030399) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:19.583283 run osmo-stp_10.42.42.5(pid=17634): stderr: | 20221208214718222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214718222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214718222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214718223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214718225 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214718225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214718225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:19.721392 run osmo-stp_10.42.42.5(pid=17634): stdout: | (launched: 2022-12-08_21:47:18.030399) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:19.851138 run osmo-stp_10.42.42.5(pid=17634): stderr: | 20221208214718222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214718222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214718222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214718223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214718225 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214718225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214718225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:20.006600 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17634): Process ended prematurely: osmo-stp_10.42.42.5(pid=17634) [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17634)] [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 21:47:20.016112 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 21:47:20.044667 run osmo-hlr_10.42.42.2(pid=17631): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17631)] 21:47:20.096043 run osmo-hlr_10.42.42.2(pid=17631): stdout: | (launched: 2022-12-08_21:47:16.955668) 21:47:20.149215 run osmo-hlr_10.42.42.2(pid=17631): stderr: | 20221208214717233 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208214717233 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208214717233 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208214717233 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208214717233 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208214717233 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208214717246 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208214717254 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208214717255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208214717255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:47:20.222802 run osmo-msc_10.42.42.6(pid=17637): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17637)] 21:47:20.273687 run osmo-msc_10.42.42.6(pid=17637): stdout: | (launched: 2022-12-08_21:47:19.065522) 21:47:20.326865 run osmo-msc_10.42.42.6(pid=17637): stderr: | 20221208214719388 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208214719388 DLGLOBAL DEBUG validating counter group 0x7fbe33ff7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208214719388 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208214719388 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208214719388 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208214719388 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208214719390 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208214719390 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208214719390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208214719391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:47:20.380171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17630): Terminating (SIGTERM) 21:47:20.423045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17633): Terminating (SIGTERM) 21:47:20.465963 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17636): Terminating (SIGTERM) 21:47:20.509106 --- ParallelTerminationStrategy: PID 17630 died... 21:47:20.529455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17630): Terminated: ok {rc=0} 21:47:20.577049 --- ParallelTerminationStrategy: PID 17633 died... 21:47:20.596869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17633): Terminated: ok {rc=0} 21:47:20.644575 --- ParallelTerminationStrategy: PID 17636 died... 21:47:20.664437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17636): Terminated: ok {rc=0} 21:47:20.754736 bus /sierra_3: Setting Powered False 21:47:21.856602 bus /sierra_3: Setting Powered False 21:47:22.975184 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 21:47:24.122199 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:24.133886 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:47:24.190909 tst mo_mt_call_osmux.py: using LAC 16959 21:47:24.309838 tst mo_mt_call_osmux.py: using RAC 129 21:47:24.429717 tst mo_mt_call_osmux.py: using CellId 16959 21:47:24.557643 tst mo_mt_call_osmux.py: using BVCI 16960 21:47:24.677431 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:24.688908 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:24.700470 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:24.711952 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:24.723444 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:24.735135 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:47:24.855658 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:47:24.970768 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:47:25.441559 run create_hlr_db(pid=17639): Launched 21:47:25.566875 bus /sierra_2: Setting Powered False 21:47:26.628110 run create_hlr_db(pid=17639): Terminated: ok {rc=0} 21:47:27.073645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17641): Launched 21:47:27.401251 run osmo-hlr_10.42.42.2(pid=17642): Launched 21:47:27.525425 run osmo-stp_10.42.42.5: Starting osmo-stp 21:47:28.091349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17644): Launched 21:47:28.416202 run osmo-stp_10.42.42.5(pid=17645): Launched 21:47:28.547600 run osmo-msc_10.42.42.6: Starting osmo-msc 21:47:29.137199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17647): Launched 21:47:29.462117 run osmo-msc_10.42.42.6(pid=17648): Launched 21:47:29.645609 run osmo-stp_10.42.42.5(pid=17645): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17645)] 21:47:29.784571 run osmo-stp_10.42.42.5(pid=17645): stdout: | (launched: 2022-12-08_21:47:28.357462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:29.923383 run osmo-stp_10.42.42.5(pid=17645): stderr: | 20221208214728550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214728550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214728550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214728551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214728551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214728551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214728551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:30.062237 run osmo-stp_10.42.42.5(pid=17645): stdout: | (launched: 2022-12-08_21:47:28.357462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:30.192599 run osmo-stp_10.42.42.5(pid=17645): stderr: | 20221208214728550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214728550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214728550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214728551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214728551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214728551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214728551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:30.348453 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17645): Process ended prematurely: osmo-stp_10.42.42.5(pid=17645) [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17645)] [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 21:47:30.358240 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 21:47:30.387046 run osmo-hlr_10.42.42.2(pid=17642): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17642)] 21:47:30.439087 run osmo-hlr_10.42.42.2(pid=17642): stdout: | (launched: 2022-12-08_21:47:27.341757) 21:47:30.493106 run osmo-hlr_10.42.42.2(pid=17642): stderr: | 20221208214727540 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208214727540 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208214727540 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208214727540 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208214727540 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208214727540 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208214727555 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208214727565 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208214727565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208214727566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:47:30.567795 run osmo-msc_10.42.42.6(pid=17648): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17648)] 21:47:30.619920 run osmo-msc_10.42.42.6(pid=17648): stdout: | (launched: 2022-12-08_21:47:29.402942) 21:47:30.673735 run osmo-msc_10.42.42.6(pid=17648): stderr: | 20221208214729725 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208214729725 DLGLOBAL DEBUG validating counter group 0x7fb0f3c9fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208214729725 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208214729725 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208214729725 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208214729726 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208214729729 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208214729730 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208214729730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208214729730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:47:30.727612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17641): Terminating (SIGTERM) 21:47:30.770984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17644): Terminating (SIGTERM) 21:47:30.814396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17647): Terminating (SIGTERM) 21:47:30.875737 --- ParallelTerminationStrategy: PID 17641 died... 21:47:30.896513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17641): Terminated: ok {rc=0} 21:47:30.947101 --- ParallelTerminationStrategy: PID 17644 died... 21:47:30.967564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17644): Terminated: ok {rc=0} 21:47:31.023242 --- ParallelTerminationStrategy: PID 17647 died... 21:47:31.043665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17647): Terminated: ok {rc=0} 21:47:31.135888 bus /sierra_3: Setting Powered False 21:47:32.240780 bus /sierra_3: Setting Powered False 21:47:33.360906 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 21:47:34.595900 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:47:34.602897 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 21:47:34.624504 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 21:47:34.652806 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 21:47:34.703548 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 21:47:34.724399 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 21:47:34.751849 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 21:47:35.306878 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 21:47:35.355902 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:35.366944 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:47:35.421489 tst mo_mt_call.py: using LAC 16960 21:47:35.542333 tst mo_mt_call.py: using RAC 130 21:47:35.660636 tst mo_mt_call.py: using CellId 16960 21:47:35.780244 tst mo_mt_call.py: using BVCI 16961 21:47:35.891334 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:35.902333 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:35.913016 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:35.923657 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:35.934431 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:35.945155 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:47:36.064012 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:47:36.183467 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:47:36.689282 run create_hlr_db(pid=17654): Launched 21:47:36.814376 bus /sierra_2: Setting Powered False 21:47:37.878464 run create_hlr_db(pid=17654): Terminated: ok {rc=0} 21:47:38.316651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17656): Launched 21:47:38.620536 run osmo-hlr_10.42.42.2(pid=17657): Launched 21:47:38.736767 run osmo-stp_10.42.42.5: Starting osmo-stp 21:47:39.276649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17659): Launched 21:47:39.581773 run osmo-stp_10.42.42.5(pid=17660): Launched 21:47:39.698204 run osmo-msc_10.42.42.6: Starting osmo-msc 21:47:40.252034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17662): Launched 21:47:40.556624 run osmo-msc_10.42.42.6(pid=17663): Launched 21:47:40.726660 run osmo-stp_10.42.42.5(pid=17660): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17660)] 21:47:40.856432 run osmo-stp_10.42.42.5(pid=17660): stdout: | (launched: 2022-12-08_21:47:39.525859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:40.985895 run osmo-stp_10.42.42.5(pid=17660): stderr: | 20221208214739697 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214739698 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214739698 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214739698 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214739699 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214739699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214739699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:41.113617 run osmo-stp_10.42.42.5(pid=17660): stdout: | (launched: 2022-12-08_21:47:39.525859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:41.235325 run osmo-stp_10.42.42.5(pid=17660): stderr: | 20221208214739697 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214739698 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214739698 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214739698 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214739699 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214739699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214739699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:41.380580 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17660): Process ended prematurely: osmo-stp_10.42.42.5(pid=17660) [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17660)] [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 21:47:41.389365 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 21:47:41.415989 run osmo-hlr_10.42.42.2(pid=17657): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17657)] 21:47:41.464896 run osmo-hlr_10.42.42.2(pid=17657): stdout: | (launched: 2022-12-08_21:47:38.565103) 21:47:41.515808 run osmo-hlr_10.42.42.2(pid=17657): stderr: | 20221208214738743 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208214738743 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208214738743 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208214738743 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208214738743 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208214738743 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208214738756 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208214738766 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208214738766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208214738767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:47:41.586561 run osmo-msc_10.42.42.6(pid=17663): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17663)] 21:47:41.635499 run osmo-msc_10.42.42.6(pid=17663): stdout: | (launched: 2022-12-08_21:47:40.500894) 21:47:41.686092 run osmo-msc_10.42.42.6(pid=17663): stderr: | 20221208214740772 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208214740772 DLGLOBAL DEBUG validating counter group 0x7f2f9c8cbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208214740772 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208214740772 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208214740772 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208214740773 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208214740774 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208214740775 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208214740775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208214740775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:47:41.736872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17656): Terminating (SIGTERM) 21:47:41.777318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17659): Terminating (SIGTERM) 21:47:41.817917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17662): Terminating (SIGTERM) 21:47:41.858642 --- ParallelTerminationStrategy: PID 17656 died... 21:47:41.878049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17656): Terminated: ok {rc=0} 21:47:41.923351 --- ParallelTerminationStrategy: PID 17659 died... 21:47:41.942096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17659): Terminated: ok {rc=0} 21:47:41.986900 --- ParallelTerminationStrategy: PID 17662 died... 21:47:42.005782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17662): Terminated: ok {rc=0} 21:47:42.091472 bus /sierra_3: Setting Powered False 21:47:43.190846 bus /sierra_3: Setting Powered False 21:47:44.309183 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 21:47:45.458804 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:45.470656 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:47:45.527876 tst mo_mt_call_osmux.py: using LAC 16961 21:47:45.661063 tst mo_mt_call_osmux.py: using RAC 131 21:47:45.789477 tst mo_mt_call_osmux.py: using CellId 16961 21:47:45.937239 tst mo_mt_call_osmux.py: using BVCI 16962 21:47:46.063911 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:46.076387 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:46.088649 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:46.103663 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:46.117545 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:46.130026 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:47:46.275728 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:47:46.429987 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:47:46.945582 run create_hlr_db(pid=17665): Launched 21:47:47.106669 bus /sierra_2: Setting Powered False 21:47:48.168002 run create_hlr_db(pid=17665): Terminated: ok {rc=0} 21:47:48.615052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17667): Launched 21:47:48.940635 run osmo-hlr_10.42.42.2(pid=17668): Launched 21:47:49.064520 run osmo-stp_10.42.42.5: Starting osmo-stp 21:47:49.630651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17670): Launched 21:47:49.956239 run osmo-stp_10.42.42.5(pid=17671): Launched 21:47:50.081353 run osmo-msc_10.42.42.6: Starting osmo-msc 21:47:50.670903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17673): Launched 21:47:50.996670 run osmo-msc_10.42.42.6(pid=17674): Launched 21:47:51.178735 run osmo-stp_10.42.42.5(pid=17671): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17671)] 21:47:51.317130 run osmo-stp_10.42.42.5(pid=17671): stdout: | (launched: 2022-12-08_21:47:49.897166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:51.458275 run osmo-stp_10.42.42.5(pid=17671): stderr: | 20221208214750091 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214750092 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214750092 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214750092 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214750093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214750093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214750093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:51.595285 run osmo-stp_10.42.42.5(pid=17671): stdout: | (launched: 2022-12-08_21:47:49.897166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:51.726296 run osmo-stp_10.42.42.5(pid=17671): stderr: | 20221208214750091 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214750092 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214750092 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214750092 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214750093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214750093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214750093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:51.882332 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17671): Process ended prematurely: osmo-stp_10.42.42.5(pid=17671) [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17671)] [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 21:47:51.892131 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 21:47:51.921038 run osmo-hlr_10.42.42.2(pid=17668): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17668)] 21:47:51.973670 run osmo-hlr_10.42.42.2(pid=17668): stdout: | (launched: 2022-12-08_21:47:48.881759) 21:47:52.028171 run osmo-hlr_10.42.42.2(pid=17668): stderr: | 20221208214749081 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208214749081 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208214749081 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208214749081 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208214749081 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208214749081 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208214749094 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208214749102 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208214749103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208214749103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:47:52.102900 run osmo-msc_10.42.42.6(pid=17674): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17674)] 21:47:52.155078 run osmo-msc_10.42.42.6(pid=17674): stdout: | (launched: 2022-12-08_21:47:50.937458) 21:47:52.209075 run osmo-msc_10.42.42.6(pid=17674): stderr: | 20221208214751281 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208214751282 DLGLOBAL DEBUG validating counter group 0x7f08d6cdac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208214751282 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208214751282 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208214751282 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208214751282 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208214751284 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208214751284 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208214751284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208214751284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:47:52.263138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17667): Terminating (SIGTERM) 21:47:52.306471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17670): Terminating (SIGTERM) 21:47:52.350007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17673): Terminating (SIGTERM) 21:47:52.393669 --- ParallelTerminationStrategy: PID 17667 died... 21:47:52.414138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17667): Terminated: ok {rc=0} 21:47:52.462582 --- ParallelTerminationStrategy: PID 17670 died... 21:47:52.482687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17670): Terminated: ok {rc=0} 21:47:52.530964 --- ParallelTerminationStrategy: PID 17673 died... 21:47:52.551205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17673): Terminated: ok {rc=0} 21:47:52.642000 bus /sierra_3: Setting Powered False 21:47:53.740317 bus /sierra_3: Setting Powered False 21:47:54.857266 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 21:47:56.090932 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:47:56.097140 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 21:47:56.117420 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 21:47:56.144297 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 21:47:56.201211 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 21:47:56.221500 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 21:47:56.247361 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 21:47:56.792052 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 21:47:56.840614 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:47:56.851493 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:47:56.905718 tst mo_mt_call.py: using LAC 16962 21:47:57.026486 tst mo_mt_call.py: using RAC 132 21:47:57.146346 tst mo_mt_call.py: using CellId 16962 21:47:57.264552 tst mo_mt_call.py: using BVCI 16963 21:47:57.375711 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:47:57.386832 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:47:57.397554 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:47:57.408171 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:47:57.418823 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:47:57.429588 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:47:57.544694 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:47:57.663628 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:47:58.170278 run create_hlr_db(pid=17679): Launched 21:47:58.295163 bus /sierra_2: Setting Powered False 21:47:59.359775 run create_hlr_db(pid=17679): Terminated: ok {rc=0} 21:47:59.813912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17681): Launched 21:48:00.140114 run osmo-hlr_10.42.42.2(pid=17682): Launched 21:48:00.264787 run osmo-stp_10.42.42.5: Starting osmo-stp 21:48:00.834250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17684): Launched 21:48:01.199409 run osmo-stp_10.42.42.5(pid=17685): Launched 21:48:01.438947 run osmo-msc_10.42.42.6: Starting osmo-msc 21:48:02.100826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17687): Launched 21:48:02.435773 run osmo-msc_10.42.42.6(pid=17688): Launched 21:48:02.617366 run osmo-stp_10.42.42.5(pid=17685): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17685)] 21:48:02.755927 run osmo-stp_10.42.42.5(pid=17685): stdout: | (launched: 2022-12-08_21:48:01.134069) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:02.894814 run osmo-stp_10.42.42.5(pid=17685): stderr: | 20221208214801478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214801478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214801478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214801479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214801479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214801479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214801479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:03.034227 run osmo-stp_10.42.42.5(pid=17685): stdout: | (launched: 2022-12-08_21:48:01.134069) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:03.165123 run osmo-stp_10.42.42.5(pid=17685): stderr: | 20221208214801478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214801478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214801478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214801479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214801479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214801479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214801479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:03.321846 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17685): Process ended prematurely: osmo-stp_10.42.42.5(pid=17685) [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17685)] [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 21:48:03.331409 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 21:48:03.360923 run osmo-hlr_10.42.42.2(pid=17682): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17682)] 21:48:03.413199 run osmo-hlr_10.42.42.2(pid=17682): stdout: | (launched: 2022-12-08_21:48:00.080911) 21:48:03.467032 run osmo-hlr_10.42.42.2(pid=17682): stderr: | 20221208214800281 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208214800281 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208214800281 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208214800281 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208214800281 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208214800282 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208214800294 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208214800302 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208214800302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208214800302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:48:03.541449 run osmo-msc_10.42.42.6(pid=17688): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17688)] 21:48:03.593406 run osmo-msc_10.42.42.6(pid=17688): stdout: | (launched: 2022-12-08_21:48:02.376496) 21:48:03.647266 run osmo-msc_10.42.42.6(pid=17688): stderr: | 20221208214802700 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208214802700 DLGLOBAL DEBUG validating counter group 0x7f2740886c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208214802700 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208214802700 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208214802700 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208214802700 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208214802702 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208214802703 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208214802703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208214802703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:48:03.701379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17681): Terminating (SIGTERM) 21:48:03.744556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17684): Terminating (SIGTERM) 21:48:03.787941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17687): Terminating (SIGTERM) 21:48:03.831664 --- ParallelTerminationStrategy: PID 17681 died... 21:48:03.851962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17681): Terminated: ok {rc=0} 21:48:03.900821 --- ParallelTerminationStrategy: PID 17684 died... 21:48:03.920860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17684): Terminated: ok {rc=0} 21:48:03.969545 --- ParallelTerminationStrategy: PID 17687 died... 21:48:03.989398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17687): Terminated: ok {rc=0} 21:48:04.079383 bus /sierra_3: Setting Powered False 21:48:05.179912 bus /sierra_3: Setting Powered False 21:48:06.298485 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 21:48:07.444568 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:07.455999 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:48:07.512264 tst mo_mt_call_osmux.py: using LAC 16963 21:48:07.632671 tst mo_mt_call_osmux.py: using RAC 133 21:48:07.752863 tst mo_mt_call_osmux.py: using CellId 16963 21:48:07.874215 tst mo_mt_call_osmux.py: using BVCI 16964 21:48:07.987824 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:07.998744 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:08.009511 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:08.020184 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:08.030885 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:08.041652 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:48:08.159566 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:48:08.274643 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:48:08.747519 run create_hlr_db(pid=17690): Launched 21:48:08.871905 bus /sierra_2: Setting Powered False 21:48:09.934064 run create_hlr_db(pid=17690): Terminated: ok {rc=0} 21:48:10.379094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17692): Launched 21:48:10.705336 run osmo-hlr_10.42.42.2(pid=17693): Launched 21:48:10.829991 run osmo-stp_10.42.42.5: Starting osmo-stp 21:48:11.390907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17695): Launched 21:48:11.716460 run osmo-stp_10.42.42.5(pid=17696): Launched 21:48:11.840108 run osmo-msc_10.42.42.6: Starting osmo-msc 21:48:12.429879 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17698): Launched 21:48:12.756087 run osmo-msc_10.42.42.6(pid=17699): Launched 21:48:12.937772 run osmo-stp_10.42.42.5(pid=17696): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17696)] 21:48:13.076446 run osmo-stp_10.42.42.5(pid=17696): stdout: | (launched: 2022-12-08_21:48:11.657366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:13.215428 run osmo-stp_10.42.42.5(pid=17696): stderr: | 20221208214811850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214811850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214811850 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214811851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214811851 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214811851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214811851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:13.353554 run osmo-stp_10.42.42.5(pid=17696): stdout: | (launched: 2022-12-08_21:48:11.657366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:13.484036 run osmo-stp_10.42.42.5(pid=17696): stderr: | 20221208214811850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214811850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214811850 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214811851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214811851 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214811851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214811851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:13.639978 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17696): Process ended prematurely: osmo-stp_10.42.42.5(pid=17696) [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17696)] [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 21:48:13.649802 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 21:48:13.678602 run osmo-hlr_10.42.42.2(pid=17693): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17693)] 21:48:13.730491 run osmo-hlr_10.42.42.2(pid=17693): stdout: | (launched: 2022-12-08_21:48:10.645989) 21:48:13.784049 run osmo-hlr_10.42.42.2(pid=17693): stderr: | 20221208214810846 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208214810846 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208214810846 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208214810846 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208214810846 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208214810846 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208214810858 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208214810866 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208214810867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208214810867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:48:13.858679 run osmo-msc_10.42.42.6(pid=17699): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17699)] 21:48:13.910568 run osmo-msc_10.42.42.6(pid=17699): stdout: | (launched: 2022-12-08_21:48:12.696780) 21:48:13.964577 run osmo-msc_10.42.42.6(pid=17699): stderr: | 20221208214813019 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208214813019 DLGLOBAL DEBUG validating counter group 0x7fd6039e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208214813020 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208214813020 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208214813020 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208214813020 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208214813022 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208214813022 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208214813022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208214813022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:48:14.018523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17692): Terminating (SIGTERM) 21:48:14.062209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17695): Terminating (SIGTERM) 21:48:14.105681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17698): Terminating (SIGTERM) 21:48:14.149207 --- ParallelTerminationStrategy: PID 17692 died... 21:48:14.169645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17692): Terminated: ok {rc=0} 21:48:14.217639 --- ParallelTerminationStrategy: PID 17695 died... 21:48:14.237744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17695): Terminated: ok {rc=0} 21:48:14.285548 --- ParallelTerminationStrategy: PID 17698 died... 21:48:14.305598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17698): Terminated: ok {rc=0} 21:48:14.395839 bus /sierra_3: Setting Powered False 21:48:15.496845 bus /sierra_3: Setting Powered False 21:48:16.618221 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 21:48:17.863631 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:48:17.870447 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 21:48:17.892308 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 21:48:17.919684 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 21:48:17.972282 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 21:48:17.993359 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 21:48:18.020822 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 21:48:18.571715 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 21:48:18.624386 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:18.635650 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 21:48:18.692673 tst mo_mt_call.py: using LAC 16964 21:48:18.822392 tst mo_mt_call.py: using RAC 134 21:48:18.952801 tst mo_mt_call.py: using CellId 16964 21:48:19.081400 tst mo_mt_call.py: using BVCI 16965 21:48:19.200026 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:19.211474 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:19.222844 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:19.234293 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:19.245889 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:19.257519 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:48:19.375174 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:48:19.490433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:48:19.962866 run create_hlr_db(pid=17704): Launched 21:48:20.088872 bus /sierra_2: Setting Powered False 21:48:21.149893 run create_hlr_db(pid=17704): Terminated: ok {rc=0} 21:48:21.575422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17706): Launched 21:48:21.879402 run osmo-hlr_10.42.42.2(pid=17707): Launched 21:48:21.994836 run osmo-stp_10.42.42.5: Starting osmo-stp 21:48:22.535532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17709): Launched 21:48:22.838814 run osmo-stp_10.42.42.5(pid=17710): Launched 21:48:22.953446 run osmo-msc_10.42.42.6: Starting osmo-msc 21:48:23.502333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17712): Launched 21:48:23.806877 run osmo-msc_10.42.42.6(pid=17713): Launched 21:48:23.990183 run osmo-stp_10.42.42.5(pid=17710): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17710)] 21:48:24.131274 run osmo-stp_10.42.42.5(pid=17710): stdout: | (launched: 2022-12-08_21:48:22.783455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:24.273134 run osmo-stp_10.42.42.5(pid=17710): stderr: | 20221208214822953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214822953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214822953 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214822954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214822954 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214822954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214822954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:24.410713 run osmo-stp_10.42.42.5(pid=17710): stdout: | (launched: 2022-12-08_21:48:22.783455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:24.540466 run osmo-stp_10.42.42.5(pid=17710): stderr: | 20221208214822953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214822953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214822953 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214822954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214822954 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214822954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214822954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:24.696428 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17710): Process ended prematurely: osmo-stp_10.42.42.5(pid=17710) [trial-2350↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17710)] [trial-2350↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 21:48:24.706161 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 21:48:24.734397 run osmo-hlr_10.42.42.2(pid=17707): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17707)] 21:48:24.788250 run osmo-hlr_10.42.42.2(pid=17707): stdout: | (launched: 2022-12-08_21:48:21.823738) 21:48:24.839411 run osmo-hlr_10.42.42.2(pid=17707): stderr: | 20221208214821998 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208214821998 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208214821998 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208214821998 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208214821998 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208214821998 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208214822010 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208214822019 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208214822020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208214822020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:48:24.909609 run osmo-msc_10.42.42.6(pid=17713): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17713)] 21:48:24.958869 run osmo-msc_10.42.42.6(pid=17713): stdout: | (launched: 2022-12-08_21:48:23.750402) 21:48:25.009468 run osmo-msc_10.42.42.6(pid=17713): stderr: | 20221208214824064 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208214824064 DLGLOBAL DEBUG validating counter group 0x7fd02def1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208214824064 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208214824065 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208214824065 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208214824065 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208214824067 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208214824067 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208214824067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208214824067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:48:25.060369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17706): Terminating (SIGTERM) 21:48:25.101189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17709): Terminating (SIGTERM) 21:48:25.141919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17712): Terminating (SIGTERM) 21:48:25.182835 --- ParallelTerminationStrategy: PID 17706 died... 21:48:25.202123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17706): Terminated: ok {rc=0} 21:48:25.248259 --- ParallelTerminationStrategy: PID 17709 died... 21:48:25.266964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17709): Terminated: ok {rc=0} 21:48:25.312847 --- ParallelTerminationStrategy: PID 17712 died... 21:48:25.332082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17712): Terminated: ok {rc=0} 21:48:25.418459 bus /sierra_3: Setting Powered False 21:48:26.518175 bus /sierra_3: Setting Powered False 21:48:27.636485 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 21:48:28.787599 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:28.799800 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 21:48:28.857464 tst mo_mt_call_osmux.py: using LAC 16965 21:48:28.986956 tst mo_mt_call_osmux.py: using RAC 135 21:48:29.117429 tst mo_mt_call_osmux.py: using CellId 16965 21:48:29.239769 tst mo_mt_call_osmux.py: using BVCI 16966 21:48:29.352719 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:29.363706 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:29.374460 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:29.385652 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:29.396856 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:29.408368 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:48:29.527828 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:48:29.642648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:48:30.116387 run create_hlr_db(pid=17715): Launched 21:48:30.240797 bus /sierra_2: Setting Powered False 21:48:31.317198 run create_hlr_db(pid=17715): Terminated: ok {rc=0} 21:48:31.822050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17717): Launched 21:48:32.166185 run osmo-hlr_10.42.42.2(pid=17718): Launched 21:48:32.283339 run osmo-stp_10.42.42.5: Starting osmo-stp 21:48:32.808841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17720): Launched 21:48:33.113447 run osmo-stp_10.42.42.5(pid=17721): Launched 21:48:33.229629 run osmo-msc_10.42.42.6: Starting osmo-msc 21:48:33.780751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17723): Launched 21:48:34.085250 run osmo-msc_10.42.42.6(pid=17724): Launched 21:48:34.254853 run osmo-stp_10.42.42.5(pid=17721): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17721)] 21:48:34.383693 run osmo-stp_10.42.42.5(pid=17721): stdout: | (launched: 2022-12-08_21:48:33.057860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:34.513362 run osmo-stp_10.42.42.5(pid=17721): stderr: | 20221208214833232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214833232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214833232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214833233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214833233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214833233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214833233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:34.640834 run osmo-stp_10.42.42.5(pid=17721): stdout: | (launched: 2022-12-08_21:48:33.057860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:34.762173 run osmo-stp_10.42.42.5(pid=17721): stderr: | 20221208214833232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214833232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214833232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214833233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214833233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214833233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214833233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:34.907329 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17721): Process ended prematurely: osmo-stp_10.42.42.5(pid=17721) [trial-2350↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17721)] [trial-2350↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 21:48:34.916437 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 21:48:34.943466 run osmo-hlr_10.42.42.2(pid=17718): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17718)] 21:48:34.992561 run osmo-hlr_10.42.42.2(pid=17718): stdout: | (launched: 2022-12-08_21:48:32.102503) 21:48:35.043406 run osmo-hlr_10.42.42.2(pid=17718): stderr: | 20221208214832287 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208214832287 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208214832287 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208214832287 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208214832287 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208214832287 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208214832302 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208214832312 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208214832312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208214832312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:48:35.113660 run osmo-msc_10.42.42.6(pid=17724): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17724)] 21:48:35.162526 run osmo-msc_10.42.42.6(pid=17724): stdout: | (launched: 2022-12-08_21:48:34.029492) 21:48:35.212855 run osmo-msc_10.42.42.6(pid=17724): stderr: | 20221208214834304 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208214834304 DLGLOBAL DEBUG validating counter group 0x7fe80583cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208214834304 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208214834304 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208214834304 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208214834305 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208214834307 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208214834308 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208214834308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208214834308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:48:35.263273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17717): Terminating (SIGTERM) 21:48:35.303330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17720): Terminating (SIGTERM) 21:48:35.343734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17723): Terminating (SIGTERM) 21:48:35.384297 --- ParallelTerminationStrategy: PID 17717 died... 21:48:35.403662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17717): Terminated: ok {rc=0} 21:48:35.448900 --- ParallelTerminationStrategy: PID 17720 died... 21:48:35.467815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17720): Terminated: ok {rc=0} 21:48:35.513037 --- ParallelTerminationStrategy: PID 17723 died... 21:48:35.531852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17723): Terminated: ok {rc=0} 21:48:35.618915 bus /sierra_3: Setting Powered False 21:48:36.718987 bus /sierra_3: Setting Powered False 21:48:37.836047 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 21:48:39.068556 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:48:39.074890 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 21:48:39.095355 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 21:48:39.121530 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 21:48:39.174370 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 21:48:39.194853 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 21:48:39.220542 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 21:48:39.772083 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 21:48:39.826585 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:39.838083 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:48:39.895787 tst mo_mt_call.py: using LAC 16966 21:48:40.026647 tst mo_mt_call.py: using RAC 136 21:48:40.156637 tst mo_mt_call.py: using CellId 16966 21:48:40.285799 tst mo_mt_call.py: using BVCI 16967 21:48:40.406993 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:40.418494 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:40.429772 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:40.441401 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:40.453193 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:40.464525 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:48:40.583587 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:48:40.700483 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:48:41.207216 run create_hlr_db(pid=17729): Launched 21:48:41.331524 bus /sierra_2: Setting Powered False 21:48:42.392206 run create_hlr_db(pid=17729): Terminated: ok {rc=0} 21:48:42.827325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17731): Launched 21:48:43.131429 run osmo-hlr_10.42.42.2(pid=17732): Launched 21:48:43.246778 run osmo-stp_10.42.42.5: Starting osmo-stp 21:48:43.774590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17734): Launched 21:48:44.079701 run osmo-stp_10.42.42.5(pid=17735): Launched 21:48:44.196305 run osmo-msc_10.42.42.6: Starting osmo-msc 21:48:44.747967 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17737): Launched 21:48:45.053777 run osmo-msc_10.42.42.6(pid=17738): Launched 21:48:45.225997 run osmo-stp_10.42.42.5(pid=17735): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17735)] 21:48:45.359863 run osmo-stp_10.42.42.5(pid=17735): stdout: | (launched: 2022-12-08_21:48:44.023717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:45.489972 run osmo-stp_10.42.42.5(pid=17735): stderr: | 20221208214844196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214844197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214844197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214844197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214844198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214844198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214844198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:45.618618 run osmo-stp_10.42.42.5(pid=17735): stdout: | (launched: 2022-12-08_21:48:44.023717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:45.740244 run osmo-stp_10.42.42.5(pid=17735): stderr: | 20221208214844196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214844197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214844197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214844197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214844198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214844198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214844198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:45.909984 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17735): Process ended prematurely: osmo-stp_10.42.42.5(pid=17735) [trial-2350↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17735)] [trial-2350↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 21:48:45.919657 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 21:48:45.947499 run osmo-hlr_10.42.42.2(pid=17732): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17732)] 21:48:45.997580 run osmo-hlr_10.42.42.2(pid=17732): stdout: | (launched: 2022-12-08_21:48:43.075913) 21:48:46.057435 run osmo-hlr_10.42.42.2(pid=17732): stderr: | 20221208214843254 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208214843254 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208214843254 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208214843254 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208214843254 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208214843254 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208214843266 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208214843275 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208214843276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208214843276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:48:46.143636 run osmo-msc_10.42.42.6(pid=17738): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17738)] 21:48:46.203854 run osmo-msc_10.42.42.6(pid=17738): stdout: | (launched: 2022-12-08_21:48:44.998124) 21:48:46.266118 run osmo-msc_10.42.42.6(pid=17738): stderr: | 20221208214845270 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208214845270 DLGLOBAL DEBUG validating counter group 0x7fc4ac5e3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208214845270 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208214845270 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208214845271 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208214845271 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208214845273 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208214845273 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208214845273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208214845273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:48:46.327292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17731): Terminating (SIGTERM) 21:48:46.374551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17734): Terminating (SIGTERM) 21:48:46.422141 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17737): Terminating (SIGTERM) 21:48:46.473599 --- ParallelTerminationStrategy: PID 17731 died... 21:48:46.496871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17731): Terminated: ok {rc=0} 21:48:46.551940 --- ParallelTerminationStrategy: PID 17734 died... 21:48:46.576259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17734): Terminated: ok {rc=0} 21:48:46.632392 --- ParallelTerminationStrategy: PID 17737 died... 21:48:46.656641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17737): Terminated: ok {rc=0} 21:48:46.759793 bus /sierra_3: Setting Powered False 21:48:47.864631 bus /sierra_3: Setting Powered False 21:48:48.980033 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 21:48:50.129258 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:50.140617 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:48:50.196809 tst mo_mt_call_osmux.py: using LAC 16967 21:48:50.318873 tst mo_mt_call_osmux.py: using RAC 137 21:48:50.441562 tst mo_mt_call_osmux.py: using CellId 16967 21:48:50.563968 tst mo_mt_call_osmux.py: using BVCI 16968 21:48:50.676681 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:50.687686 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:50.698476 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:50.709193 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:50.719819 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:50.730614 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:48:50.849854 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:48:50.969675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:48:51.443092 run create_hlr_db(pid=17750): Launched 21:48:51.567296 bus /sierra_2: Setting Powered False 21:48:52.628520 run create_hlr_db(pid=17750): Terminated: ok {rc=0} 21:48:53.053994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17752): Launched 21:48:53.357745 run osmo-hlr_10.42.42.2(pid=17753): Launched 21:48:53.472445 run osmo-stp_10.42.42.5: Starting osmo-stp 21:48:53.998933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17755): Launched 21:48:54.302460 run osmo-stp_10.42.42.5(pid=17756): Launched 21:48:54.417985 run osmo-msc_10.42.42.6: Starting osmo-msc 21:48:54.968072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17758): Launched 21:48:55.273393 run osmo-msc_10.42.42.6(pid=17759): Launched 21:48:55.443930 run osmo-stp_10.42.42.5(pid=17756): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17756)] 21:48:55.574126 run osmo-stp_10.42.42.5(pid=17756): stdout: | (launched: 2022-12-08_21:48:54.246995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:55.703721 run osmo-stp_10.42.42.5(pid=17756): stderr: | 20221208214854416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214854417 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214854417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214854417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214854418 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214854418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214854418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:55.831331 run osmo-stp_10.42.42.5(pid=17756): stdout: | (launched: 2022-12-08_21:48:54.246995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:55.953625 run osmo-stp_10.42.42.5(pid=17756): stderr: | 20221208214854416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214854417 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214854417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214854417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214854418 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214854418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214854418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:56.099707 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17756): Process ended prematurely: osmo-stp_10.42.42.5(pid=17756) [trial-2350↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17756)] [trial-2350↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 21:48:56.108750 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 21:48:56.135501 run osmo-hlr_10.42.42.2(pid=17753): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17753)] 21:48:56.184185 run osmo-hlr_10.42.42.2(pid=17753): stdout: | (launched: 2022-12-08_21:48:53.302484) 21:48:56.234247 run osmo-hlr_10.42.42.2(pid=17753): stderr: | 20221208214853480 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208214853480 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208214853480 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208214853481 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208214853481 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208214853481 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208214853493 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208214853502 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208214853502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208214853502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:48:56.303651 run osmo-msc_10.42.42.6(pid=17759): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17759)] 21:48:56.351708 run osmo-msc_10.42.42.6(pid=17759): stdout: | (launched: 2022-12-08_21:48:55.217672) 21:48:56.401501 run osmo-msc_10.42.42.6(pid=17759): stderr: | 20221208214855493 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208214855493 DLGLOBAL DEBUG validating counter group 0x7f449c730c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208214855493 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208214855493 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208214855493 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208214855493 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208214855495 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208214855495 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208214855495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208214855496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:48:56.451648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17752): Terminating (SIGTERM) 21:48:56.491633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17755): Terminating (SIGTERM) 21:48:56.531691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17758): Terminating (SIGTERM) 21:48:56.572203 --- ParallelTerminationStrategy: PID 17752 died... 21:48:56.591473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17752): Terminated: ok {rc=0} 21:48:56.636045 --- ParallelTerminationStrategy: PID 17755 died... 21:48:56.655099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17755): Terminated: ok {rc=0} 21:48:56.700172 --- ParallelTerminationStrategy: PID 17758 died... 21:48:56.718741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17758): Terminated: ok {rc=0} 21:48:56.805455 bus /sierra_3: Setting Powered False 21:48:57.905680 bus /sierra_3: Setting Powered False 21:48:59.021796 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 21:49:00.254260 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:49:00.260442 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:49:00.281244 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 21:49:00.308074 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:49:00.358809 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:49:00.379303 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 21:49:00.405630 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:49:00.970246 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 21:49:01.034680 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:01.049749 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:49:01.115960 tst mo_mt_call.py: using LAC 16968 21:49:01.250682 tst mo_mt_call.py: using RAC 138 21:49:01.420424 tst mo_mt_call.py: using CellId 16968 21:49:01.572905 tst mo_mt_call.py: using BVCI 16969 21:49:01.727036 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:01.742100 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:01.757203 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:01.771905 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:01.785732 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:01.800387 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:49:01.940899 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:49:02.084099 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:49:02.596637 run create_hlr_db(pid=17765): Launched 21:49:02.722344 bus /sierra_2: Setting Powered False 21:49:03.783312 run create_hlr_db(pid=17765): Terminated: ok {rc=0} 21:49:04.230716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17767): Launched 21:49:04.557457 run osmo-hlr_10.42.42.2(pid=17768): Launched 21:49:04.683079 run osmo-stp_10.42.42.5: Starting osmo-stp 21:49:05.250404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17770): Launched 21:49:05.577254 run osmo-stp_10.42.42.5(pid=17771): Launched 21:49:05.702956 run osmo-msc_10.42.42.6: Starting osmo-msc 21:49:06.295988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17773): Launched 21:49:06.622335 run osmo-msc_10.42.42.6(pid=17774): Launched 21:49:06.803076 run osmo-stp_10.42.42.5(pid=17771): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17771)] 21:49:06.941671 run osmo-stp_10.42.42.5(pid=17771): stdout: | (launched: 2022-12-08_21:49:05.517971) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:07.081608 run osmo-stp_10.42.42.5(pid=17771): stderr: | 20221208214905714 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214905714 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214905714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214905715 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214905715 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214905715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214905715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:07.219799 run osmo-stp_10.42.42.5(pid=17771): stdout: | (launched: 2022-12-08_21:49:05.517971) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:07.350638 run osmo-stp_10.42.42.5(pid=17771): stderr: | 20221208214905714 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214905714 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214905714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214905715 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214905715 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214905715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214905715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:07.506725 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17771): Process ended prematurely: osmo-stp_10.42.42.5(pid=17771) [trial-2350↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17771)] [trial-2350↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 21:49:07.516110 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 21:49:07.544390 run osmo-hlr_10.42.42.2(pid=17768): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17768)] 21:49:07.595882 run osmo-hlr_10.42.42.2(pid=17768): stdout: | (launched: 2022-12-08_21:49:04.498068) 21:49:07.649078 run osmo-hlr_10.42.42.2(pid=17768): stderr: | 20221208214904697 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208214904697 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208214904697 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208214904697 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208214904697 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208214904697 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208214904710 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208214904721 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208214904721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208214904721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:49:07.722825 run osmo-msc_10.42.42.6(pid=17774): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17774)] 21:49:07.774207 run osmo-msc_10.42.42.6(pid=17774): stdout: | (launched: 2022-12-08_21:49:06.563050) 21:49:07.827154 run osmo-msc_10.42.42.6(pid=17774): stderr: | 20221208214906886 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208214906886 DLGLOBAL DEBUG validating counter group 0x7f1edfbd9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208214906886 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208214906886 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208214906886 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208214906886 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208214906888 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208214906889 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208214906889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208214906889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:49:07.880415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17767): Terminating (SIGTERM) 21:49:07.923199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17770): Terminating (SIGTERM) 21:49:07.966184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17773): Terminating (SIGTERM) 21:49:08.009200 --- ParallelTerminationStrategy: PID 17767 died... 21:49:08.029439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17767): Terminated: ok {rc=0} 21:49:08.077528 --- ParallelTerminationStrategy: PID 17770 died... 21:49:08.097370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17770): Terminated: ok {rc=0} 21:49:08.144878 --- ParallelTerminationStrategy: PID 17773 died... 21:49:08.165051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17773): Terminated: ok {rc=0} 21:49:08.254679 bus /sierra_3: Setting Powered False 21:49:09.355300 bus /sierra_3: Setting Powered False 21:49:10.473583 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 21:49:11.620211 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:11.632003 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:49:11.694948 tst mo_mt_call_osmux.py: using LAC 16969 21:49:11.813722 tst mo_mt_call_osmux.py: using RAC 139 21:49:11.934991 tst mo_mt_call_osmux.py: using CellId 16969 21:49:12.053331 tst mo_mt_call_osmux.py: using BVCI 16970 21:49:12.164120 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:12.175206 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:12.186041 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:12.196774 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:12.207562 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:12.218524 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:49:12.332450 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:49:12.450896 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:49:12.924329 run create_hlr_db(pid=17776): Launched 21:49:13.048548 bus /sierra_2: Setting Powered False 21:49:14.109962 run create_hlr_db(pid=17776): Terminated: ok {rc=0} 21:49:14.556091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17778): Launched 21:49:14.884510 run osmo-hlr_10.42.42.2(pid=17779): Launched 21:49:15.009403 run osmo-stp_10.42.42.5: Starting osmo-stp 21:49:15.576899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17781): Launched 21:49:15.930106 run osmo-stp_10.42.42.5(pid=17782): Launched 21:49:16.260772 run osmo-msc_10.42.42.6: Starting osmo-msc 21:49:16.957636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17784): Launched 21:49:17.293961 run osmo-msc_10.42.42.6(pid=17785): Launched 21:49:17.499509 run osmo-stp_10.42.42.5(pid=17782): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17782)] 21:49:17.629656 run osmo-stp_10.42.42.5(pid=17782): stdout: | (launched: 2022-12-08_21:49:15.861524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:17.760385 run osmo-stp_10.42.42.5(pid=17782): stderr: | 20221208214916097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214916097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214916098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214916098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214916102 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214916102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214916102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:17.888240 run osmo-stp_10.42.42.5(pid=17782): stdout: | (launched: 2022-12-08_21:49:15.861524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:18.009640 run osmo-stp_10.42.42.5(pid=17782): stderr: | 20221208214916097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214916097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214916098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214916098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214916102 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214916102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214916102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:18.155109 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17782): Process ended prematurely: osmo-stp_10.42.42.5(pid=17782) [trial-2350↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17782)] [trial-2350↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 21:49:18.164012 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 21:49:18.190725 run osmo-hlr_10.42.42.2(pid=17779): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17779)] 21:49:18.239207 run osmo-hlr_10.42.42.2(pid=17779): stdout: | (launched: 2022-12-08_21:49:14.824736) 21:49:18.289656 run osmo-hlr_10.42.42.2(pid=17779): stderr: | 20221208214915024 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208214915025 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208214915025 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208214915025 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208214915025 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208214915025 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208214915038 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208214915046 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208214915046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208214915046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:49:18.359762 run osmo-msc_10.42.42.6(pid=17785): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17785)] 21:49:18.408256 run osmo-msc_10.42.42.6(pid=17785): stdout: | (launched: 2022-12-08_21:49:17.223038) 21:49:18.458144 run osmo-msc_10.42.42.6(pid=17785): stderr: | 20221208214917541 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208214917541 DLGLOBAL DEBUG validating counter group 0x7fa1f3469c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208214917542 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208214917542 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208214917542 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208214917542 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208214917544 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208214917544 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208214917544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208214917544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:49:18.508454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17778): Terminating (SIGTERM) 21:49:18.548528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17781): Terminating (SIGTERM) 21:49:18.588604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17784): Terminating (SIGTERM) 21:49:18.628846 --- ParallelTerminationStrategy: PID 17778 died... 21:49:18.648181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17778): Terminated: ok {rc=0} 21:49:18.693242 --- ParallelTerminationStrategy: PID 17781 died... 21:49:18.711893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17781): Terminated: ok {rc=0} 21:49:18.756162 --- ParallelTerminationStrategy: PID 17784 died... 21:49:18.775050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17784): Terminated: ok {rc=0} 21:49:18.859656 bus /sierra_3: Setting Powered False 21:49:19.957905 bus /sierra_3: Setting Powered False 21:49:21.077935 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 21:49:22.313081 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:49:22.319850 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 21:49:22.341697 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 21:49:22.368770 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 21:49:22.421778 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 21:49:22.444148 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 21:49:22.471502 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 21:49:23.018794 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 21:49:23.071895 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:23.083146 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:49:23.140912 tst mo_mt_call.py: using LAC 16970 21:49:23.270436 tst mo_mt_call.py: using RAC 140 21:49:23.402950 tst mo_mt_call.py: using CellId 16970 21:49:23.530748 tst mo_mt_call.py: using BVCI 16971 21:49:23.650223 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:23.661586 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:23.672568 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:23.683784 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:23.695028 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:23.706393 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:49:23.825579 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:49:23.944863 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:49:24.416370 run create_hlr_db(pid=17790): Launched 21:49:24.540689 bus /sierra_2: Setting Powered False 21:49:25.601898 run create_hlr_db(pid=17790): Terminated: ok {rc=0} 21:49:26.046737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17792): Launched 21:49:26.372720 run osmo-hlr_10.42.42.2(pid=17793): Launched 21:49:26.496929 run osmo-stp_10.42.42.5: Starting osmo-stp 21:49:27.065693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17795): Launched 21:49:27.394235 run osmo-stp_10.42.42.5(pid=17796): Launched 21:49:27.518805 run osmo-msc_10.42.42.6: Starting osmo-msc 21:49:28.110456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17798): Launched 21:49:28.437304 run osmo-msc_10.42.42.6(pid=17799): Launched 21:49:28.620252 run osmo-stp_10.42.42.5(pid=17796): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17796)] 21:49:28.759195 run osmo-stp_10.42.42.5(pid=17796): stdout: | (launched: 2022-12-08_21:49:27.334972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:28.898608 run osmo-stp_10.42.42.5(pid=17796): stderr: | 20221208214927528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214927528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214927528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214927529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214927531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214927531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214927531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:29.037532 run osmo-stp_10.42.42.5(pid=17796): stdout: | (launched: 2022-12-08_21:49:27.334972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:29.168512 run osmo-stp_10.42.42.5(pid=17796): stderr: | 20221208214927528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214927528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214927528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214927529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214927531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214927531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214927531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:29.324456 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17796): Process ended prematurely: osmo-stp_10.42.42.5(pid=17796) [trial-2350↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17796)] [trial-2350↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 21:49:29.334125 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 21:49:29.362507 run osmo-hlr_10.42.42.2(pid=17793): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17793)] 21:49:29.414094 run osmo-hlr_10.42.42.2(pid=17793): stdout: | (launched: 2022-12-08_21:49:26.313745) 21:49:29.466947 run osmo-hlr_10.42.42.2(pid=17793): stderr: | 20221208214926513 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208214926513 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208214926513 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208214926514 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208214926514 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208214926514 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208214926525 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208214926534 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208214926534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208214926534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:49:29.540665 run osmo-msc_10.42.42.6(pid=17799): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17799)] 21:49:29.591732 run osmo-msc_10.42.42.6(pid=17799): stdout: | (launched: 2022-12-08_21:49:28.377943) 21:49:29.644606 run osmo-msc_10.42.42.6(pid=17799): stderr: | 20221208214928700 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208214928700 DLGLOBAL DEBUG validating counter group 0x7fb2742efc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208214928701 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208214928701 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208214928701 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208214928701 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208214928703 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208214928703 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208214928703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208214928703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:49:29.697619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17792): Terminating (SIGTERM) 21:49:29.740397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17795): Terminating (SIGTERM) 21:49:29.783152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17798): Terminating (SIGTERM) 21:49:29.826296 --- ParallelTerminationStrategy: PID 17792 died... 21:49:29.846581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17792): Terminated: ok {rc=0} 21:49:29.894138 --- ParallelTerminationStrategy: PID 17795 died... 21:49:29.913901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17795): Terminated: ok {rc=0} 21:49:29.961310 --- ParallelTerminationStrategy: PID 17798 died... 21:49:29.981059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17798): Terminated: ok {rc=0} 21:49:30.071310 bus /sierra_3: Setting Powered False 21:49:31.170641 bus /sierra_3: Setting Powered False 21:49:32.294218 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 21:49:33.442378 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:33.454089 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:49:33.511556 tst mo_mt_call_osmux.py: using LAC 16971 21:49:33.633314 tst mo_mt_call_osmux.py: using RAC 141 21:49:33.753428 tst mo_mt_call_osmux.py: using CellId 16971 21:49:33.878799 tst mo_mt_call_osmux.py: using BVCI 16972 21:49:33.990253 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:34.001246 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:34.011712 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:34.022334 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:34.032821 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:34.043505 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:49:34.160868 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:49:34.277300 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:49:34.749492 run create_hlr_db(pid=17801): Launched 21:49:34.874100 bus /sierra_2: Setting Powered False 21:49:35.935176 run create_hlr_db(pid=17801): Terminated: ok {rc=0} 21:49:36.360441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17803): Launched 21:49:36.665465 run osmo-hlr_10.42.42.2(pid=17804): Launched 21:49:36.780848 run osmo-stp_10.42.42.5: Starting osmo-stp 21:49:37.307889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17806): Launched 21:49:37.611814 run osmo-stp_10.42.42.5(pid=17807): Launched 21:49:37.727554 run osmo-msc_10.42.42.6: Starting osmo-msc 21:49:38.277269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17809): Launched 21:49:38.580863 run osmo-msc_10.42.42.6(pid=17810): Launched 21:49:38.750354 run osmo-stp_10.42.42.5(pid=17807): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17807)] 21:49:38.879604 run osmo-stp_10.42.42.5(pid=17807): stdout: | (launched: 2022-12-08_21:49:37.555985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:39.009636 run osmo-stp_10.42.42.5(pid=17807): stderr: | 20221208214937727 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214937727 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214937727 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214937727 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214937728 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214937728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214937728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:39.137132 run osmo-stp_10.42.42.5(pid=17807): stdout: | (launched: 2022-12-08_21:49:37.555985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:39.258377 run osmo-stp_10.42.42.5(pid=17807): stderr: | 20221208214937727 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214937727 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214937727 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214937727 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214937728 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214937728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214937728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:39.403400 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17807): Process ended prematurely: osmo-stp_10.42.42.5(pid=17807) [trial-2350↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17807)] [trial-2350↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 21:49:39.412184 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 21:49:39.438692 run osmo-hlr_10.42.42.2(pid=17804): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17804)] 21:49:39.487285 run osmo-hlr_10.42.42.2(pid=17804): stdout: | (launched: 2022-12-08_21:49:36.609152) 21:49:39.537411 run osmo-hlr_10.42.42.2(pid=17804): stderr: | 20221208214936786 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208214936786 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208214936786 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208214936786 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208214936786 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208214936786 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208214936798 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208214936807 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208214936807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208214936807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:49:39.607171 run osmo-msc_10.42.42.6(pid=17810): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17810)] 21:49:39.655503 run osmo-msc_10.42.42.6(pid=17810): stdout: | (launched: 2022-12-08_21:49:38.525171) 21:49:39.705569 run osmo-msc_10.42.42.6(pid=17810): stderr: | 20221208214938797 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208214938797 DLGLOBAL DEBUG validating counter group 0x7f763cdcdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208214938797 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208214938797 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208214938797 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208214938798 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208214938799 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208214938800 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208214938801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208214938801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:49:39.755880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17803): Terminating (SIGTERM) 21:49:39.796054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17806): Terminating (SIGTERM) 21:49:39.836430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17809): Terminating (SIGTERM) 21:49:39.876695 --- ParallelTerminationStrategy: PID 17803 died... 21:49:39.895930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17803): Terminated: ok {rc=0} 21:49:39.940438 --- ParallelTerminationStrategy: PID 17806 died... 21:49:39.959218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17806): Terminated: ok {rc=0} 21:49:40.003998 --- ParallelTerminationStrategy: PID 17809 died... 21:49:40.022822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17809): Terminated: ok {rc=0} 21:49:40.110265 bus /sierra_3: Setting Powered False 21:49:41.212236 bus /sierra_3: Setting Powered False 21:49:42.329412 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 emergency:sysmo --------------------------------------------------------------------- 21:49:43.560364 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:49:43.564432 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 21:49:43.584744 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 21:49:43.611805 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 21:49:43.695195 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 21:49:43.716562 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 21:49:43.743860 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 21:49:44.321765 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2350 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 21:49:44.326646 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:44.337386 tst emergency:sysmo: Using 1 x bts (candidates: 1) 21:49:44.372683 tst emergency_mo_mt_call.py: using LAC 16972 21:49:44.492628 tst emergency_mo_mt_call.py: using RAC 142 21:49:44.613473 tst emergency_mo_mt_call.py: using CellId 16972 21:49:44.730215 tst emergency_mo_mt_call.py: using BVCI 16973 21:49:44.841787 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:44.852237 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:44.862615 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:44.872849 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:44.883156 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:44.893484 tst emergency:sysmo: Using 1 x modem (candidates: 4) 21:49:45.009645 tst emergency:sysmo: Using 1 x modem (candidates: 4) 21:49:45.124853 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:49:45.589413 run create_hlr_db(pid=17815): Launched 21:49:45.712259 bus /sierra_2: Setting Powered False 21:49:46.789040 run create_hlr_db(pid=17815): Terminated: ok {rc=0} 21:49:47.270533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17817): Launched 21:49:47.591842 run osmo-hlr_10.42.42.2(pid=17818): Launched 21:49:47.714764 run osmo-stp_10.42.42.5: Starting osmo-stp 21:49:48.270928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17820): Launched 21:49:48.593216 run osmo-stp_10.42.42.5(pid=17821): Launched 21:49:48.725603 tst emergency_mo_mt_call.py: using MSISDN 6872 21:49:48.893917 run osmo-msc_10.42.42.6: Starting osmo-msc 21:49:49.470207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17823): Launched 21:49:49.789753 run osmo-msc_10.42.42.6(pid=17824): Launched 21:49:49.969508 run osmo-stp_10.42.42.5(pid=17821): ERR: Terminated: ERROR {rc=1} [trial-2350↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17821)] 21:49:50.107202 run osmo-stp_10.42.42.5(pid=17821): stdout: | (launched: 2022-12-08_21:49:48.534704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:50.245356 run osmo-stp_10.42.42.5(pid=17821): stderr: | 20221208214948730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214948730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214948730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214948731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214948731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214948731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214948731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:50.382254 run osmo-stp_10.42.42.5(pid=17821): stdout: | (launched: 2022-12-08_21:49:48.534704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:50.510837 run osmo-stp_10.42.42.5(pid=17821): stderr: | 20221208214948730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214948730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214948730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214948731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214948731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214948731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214948731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:50.664768 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=17821): Process ended prematurely: osmo-stp_10.42.42.5(pid=17821) [trial-2350↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17821)] [trial-2350↪emergency:sysmo↪emergency_mo_mt_call.py:19] 21:49:50.673707 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 21:49:50.702081 run osmo-hlr_10.42.42.2(pid=17818): ERR: Terminated: ERROR {rc=237} [trial-2350↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17818)] 21:49:50.753299 run osmo-hlr_10.42.42.2(pid=17818): stdout: | (launched: 2022-12-08_21:49:47.533683) 21:49:50.806171 run osmo-hlr_10.42.42.2(pid=17818): stderr: | 20221208214947732 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208214947732 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208214947732 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208214947732 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208214947732 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208214947732 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208214947744 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208214947752 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208214947752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208214947752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:49:50.880495 run osmo-msc_10.42.42.6(pid=17824): ERR: Terminated: ERROR {rc=2} [trial-2350↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17824)] 21:49:50.931879 run osmo-msc_10.42.42.6(pid=17824): stdout: | (launched: 2022-12-08_21:49:49.731594) 21:49:50.984912 run osmo-msc_10.42.42.6(pid=17824): stderr: | 20221208214950051 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208214950051 DLGLOBAL DEBUG validating counter group 0x7fb050c5bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208214950051 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208214950051 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208214950052 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208214950052 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208214950054 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208214950054 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208214950054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208214950054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:49:51.038430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17817): Terminating (SIGTERM) 21:49:51.081699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17820): Terminating (SIGTERM) 21:49:51.125315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17823): Terminating (SIGTERM) 21:49:51.168871 --- ParallelTerminationStrategy: PID 17817 died... 21:49:51.189548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17817): Terminated: ok {rc=0} 21:49:51.237669 --- ParallelTerminationStrategy: PID 17820 died... 21:49:51.258079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17820): Terminated: ok {rc=0} 21:49:51.306066 --- ParallelTerminationStrategy: PID 17823 died... 21:49:51.326060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17823): Terminated: ok {rc=0} 21:49:51.415249 bus /sierra_3: Setting Powered False 21:49:52.516740 bus /sierra_3: Setting Powered False 21:49:53.632862 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 21:49:54.721483 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:54.732483 tst emergency:sysmo: Using 1 x bts (candidates: 1) 21:49:54.769691 tst emergency_preemptive_call.py: using LAC 16973 21:49:54.890248 tst emergency_preemptive_call.py: using RAC 143 21:49:55.009188 tst emergency_preemptive_call.py: using CellId 16973 21:49:55.126712 tst emergency_preemptive_call.py: using BVCI 16974 21:49:55.237554 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:55.248329 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:55.258847 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:55.269196 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:55.279408 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:55.289700 tst emergency:sysmo: Using 1 x modem (candidates: 4) 21:49:55.405625 tst emergency:sysmo: Using 1 x modem (candidates: 4) 21:49:55.521611 tst emergency:sysmo: Using 1 x modem (candidates: 4) 21:49:55.639230 tst emergency:sysmo: Using 1 x modem (candidates: 4) 21:49:55.756174 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:49:56.221418 run create_hlr_db(pid=17826): Launched 21:49:56.344867 bus /sierra_2: Setting Powered False 21:49:57.404930 run create_hlr_db(pid=17826): Terminated: ok {rc=0} 21:49:57.824556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17828): Launched 21:49:58.124778 run osmo-hlr_10.42.42.2(pid=17829): Launched 21:49:58.238603 run osmo-stp_10.42.42.5: Starting osmo-stp 21:49:58.768314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17831): Launched 21:49:59.067414 run osmo-stp_10.42.42.5(pid=17832): Launched 21:49:59.191793 tst emergency_preemptive_call.py: using MSISDN 6873 21:49:59.344514 run osmo-msc_10.42.42.6: Starting osmo-msc 21:49:59.882106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17834): Launched 21:50:00.180689 run osmo-msc_10.42.42.6(pid=17835): Launched 21:50:00.354479 run osmo-stp_10.42.42.5(pid=17832): ERR: Terminated: ERROR {rc=1} [trial-2350↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17832)] 21:50:00.482636 run osmo-stp_10.42.42.5(pid=17832): stdout: | (launched: 2022-12-08_21:49:59.012421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:00.610449 run osmo-stp_10.42.42.5(pid=17832): stderr: | 20221208214959184 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214959184 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214959185 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214959186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214959186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214959186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214959186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:00.736140 run osmo-stp_10.42.42.5(pid=17832): stdout: | (launched: 2022-12-08_21:49:59.012421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:00.859892 run osmo-stp_10.42.42.5(pid=17832): stderr: | 20221208214959184 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208214959184 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208214959185 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208214959186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208214959186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208214959186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208214959186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:01.025474 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=17832): Process ended prematurely: osmo-stp_10.42.42.5(pid=17832) [trial-2350↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17832)] [trial-2350↪emergency:sysmo↪emergency_preemptive_call.py:32] 21:50:01.034313 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 21:50:01.061941 run osmo-hlr_10.42.42.2(pid=17829): ERR: Terminated: ERROR {rc=237} [trial-2350↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17829)] 21:50:01.112435 run osmo-hlr_10.42.42.2(pid=17829): stdout: | (launched: 2022-12-08_21:49:58.069426) 21:50:01.164661 run osmo-hlr_10.42.42.2(pid=17829): stderr: | 20221208214958248 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208214958248 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208214958248 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208214958248 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208214958248 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208214958248 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208214958262 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208214958272 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208214958272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208214958272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:50:01.236640 run osmo-msc_10.42.42.6(pid=17835): ERR: Terminated: ERROR {rc=2} [trial-2350↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17835)] 21:50:01.287015 run osmo-msc_10.42.42.6(pid=17835): stdout: | (launched: 2022-12-08_21:50:00.125917) 21:50:01.338944 run osmo-msc_10.42.42.6(pid=17835): stderr: | 20221208215000400 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208215000400 DLGLOBAL DEBUG validating counter group 0x7f3f3252cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208215000401 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208215000401 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208215000401 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208215000401 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208215000404 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208215000404 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208215000405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208215000405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:50:01.391438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17828): Terminating (SIGTERM) 21:50:01.432911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17831): Terminating (SIGTERM) 21:50:01.475590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17834): Terminating (SIGTERM) 21:50:01.518891 --- ParallelTerminationStrategy: PID 17828 died... 21:50:01.539416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17828): Terminated: ok {rc=0} 21:50:01.589951 --- ParallelTerminationStrategy: PID 17831 died... 21:50:01.609457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17831): Terminated: ok {rc=0} 21:50:01.655018 --- ParallelTerminationStrategy: PID 17834 died... 21:50:01.674322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17834): Terminated: ok {rc=0} 21:50:01.760264 bus /sierra_9: Setting Powered False 21:50:02.857368 bus /sierra_9: Setting Powered False 21:50:03.972462 bus /sierra_8: Setting Powered False 21:50:05.072130 bus /sierra_8: Setting Powered False 21:50:06.189231 bus /sierra_3: Setting Powered False 21:50:07.288672 bus /sierra_3: Setting Powered False 21:50:08.403981 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:sysmo --------------------------------------------------------------------- 21:50:09.668577 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:50:09.673205 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 21:50:09.694204 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 21:50:09.733870 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 21:50:09.823498 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 21:50:09.846534 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 21:50:09.885736 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 21:50:10.472404 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 21:50:10.527087 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:10.537924 tst gprs:sysmo: Using 1 x bts (candidates: 1) 21:50:10.576467 tst cs_paging_gprs_active.py: using LAC 16974 21:50:10.704309 tst cs_paging_gprs_active.py: using RAC 144 21:50:10.830842 tst cs_paging_gprs_active.py: using CellId 16974 21:50:10.959371 tst cs_paging_gprs_active.py: using BVCI 16975 21:50:11.072566 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:11.083047 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:11.093381 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:11.103652 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:11.114048 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:11.124320 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:11.134640 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:11.144777 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:11.155228 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:50:11.274221 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:50:11.395119 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:50:11.616521 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:11.946035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17843): Launched 21:50:12.231298 run iperf3-srv_10.42.42.10(pid=17844): Launched 21:50:12.351370 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:50:12.556668 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:12.864384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17845): Launched 21:50:13.131033 run iperf3-srv_10.42.42.10(pid=17846): Launched 21:50:13.245649 tst cs_paging_gprs_active.py:38: start network... 21:50:13.450347 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:50:13.924152 run create_hlr_db(pid=17847): Launched 21:50:14.049595 bus /sierra_2: Setting Powered False 21:50:15.111308 run create_hlr_db(pid=17847): Terminated: ok {rc=0} 21:50:15.558679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17849): Launched 21:50:15.917867 run osmo-hlr_10.42.42.2(pid=17850): Launched 21:50:16.145138 run osmo-stp_10.42.42.5: Starting osmo-stp 21:50:16.855125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17852): Launched 21:50:17.291914 run osmo-stp_10.42.42.5(pid=17853): Launched 21:50:17.547528 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:50:19.057937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17855): Launched 21:50:19.174581 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:50:19.433641 run patchelf(pid=17856): Launched 21:50:19.605236 run osmo-stp_10.42.42.5(pid=17853): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17853)] 21:50:19.735195 run osmo-stp_10.42.42.5(pid=17853): stdout: | (launched: 2022-12-08_21:50:17.218535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:19.867029 run osmo-stp_10.42.42.5(pid=17853): stderr: | 20221208215017433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215017433 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215017433 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215017434 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215017434 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215017434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215017434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:19.998943 run osmo-stp_10.42.42.5(pid=17853): stdout: | (launched: 2022-12-08_21:50:17.218535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:20.125893 run osmo-stp_10.42.42.5(pid=17853): stderr: | 20221208215017433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215017433 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215017433 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215017434 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215017434 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215017434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215017434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:20.275680 run patchelf(pid=17856): Terminating (SIGINT) 21:50:20.448072 run patchelf(pid=17856): Terminated: ok {rc=0} 21:50:20.572430 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17853): Process ended prematurely: osmo-stp_10.42.42.5(pid=17853) [trial-2350↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17853)] [trial-2350↪gprs:sysmo↪cs_paging_gprs_active.py:38] 21:50:20.581889 tst cs_paging_gprs_active.py:38: Test FAILED (10.1 sec) 21:50:20.609624 run osmo-hlr_10.42.42.2(pid=17850): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17850)] 21:50:20.658203 run osmo-hlr_10.42.42.2(pid=17850): stdout: | (launched: 2022-12-08_21:50:15.828290) 21:50:20.708438 run osmo-hlr_10.42.42.2(pid=17850): stderr: | 20221208215016183 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215016183 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215016183 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215016183 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215016183 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215016183 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215016206 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215016225 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215016226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215016226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:50:20.759208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17843): Terminating (SIGTERM) 21:50:20.799700 run iperf3-srv_10.42.42.10(pid=17844): Terminating (SIGTERM) 21:50:20.840189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17845): Terminating (SIGTERM) 21:50:20.880626 run iperf3-srv_10.42.42.10(pid=17846): Terminating (SIGTERM) 21:50:20.920812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17849): Terminating (SIGTERM) 21:50:20.961314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17852): Terminating (SIGTERM) 21:50:21.001801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17855): Terminating (SIGTERM) 21:50:21.042584 --- ParallelTerminationStrategy: PID 17843 died... 21:50:21.061928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17843): Terminated: ok {rc=0} 21:50:21.106969 --- ParallelTerminationStrategy: PID 17844 died... 21:50:21.125871 run iperf3-srv_10.42.42.10(pid=17844): Terminated {rc=256} 21:50:21.170754 --- ParallelTerminationStrategy: PID 17845 died... 21:50:21.189776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17845): Terminated: ok {rc=0} 21:50:21.235933 --- ParallelTerminationStrategy: PID 17846 died... 21:50:21.254987 run iperf3-srv_10.42.42.10(pid=17846): Terminated {rc=256} 21:50:21.300049 --- ParallelTerminationStrategy: PID 17849 died... 21:50:21.319120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17849): Terminated: ok {rc=0} 21:50:21.364554 --- ParallelTerminationStrategy: PID 17852 died... 21:50:21.383577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17852): Terminated: ok {rc=0} 21:50:21.428522 --- ParallelTerminationStrategy: PID 17855 died... 21:50:21.447492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17855): Terminated: ok {rc=0} 21:50:21.532729 bus /gobi_0: Setting Powered False 21:50:22.631299 bus /gobi_0: Setting Powered False 21:50:23.752001 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:sysmo iperf3.py ---------------------------------------------- 21:50:24.900533 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:24.911453 tst gprs:sysmo: Using 1 x bts (candidates: 1) 21:50:24.946520 tst iperf3.py: using LAC 16975 21:50:25.069987 tst iperf3.py: using RAC 145 21:50:25.203664 tst iperf3.py: using CellId 16975 21:50:25.324164 tst iperf3.py: using BVCI 16976 21:50:25.435372 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:25.445811 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:25.456150 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:25.466417 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:25.476422 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:25.486598 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:25.496797 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:25.507008 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:25.517312 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:50:25.636471 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:50:25.857820 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:26.186132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17857): Launched 21:50:26.470156 run iperf3-srv_10.42.42.10(pid=17858): Launched 21:50:26.592572 tst iperf3.py:8: start network... 21:50:26.812289 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:50:27.318551 run create_hlr_db(pid=17859): Launched 21:50:27.444217 bus /gobi_6: Setting Powered False 21:50:28.509121 run create_hlr_db(pid=17859): Terminated: ok {rc=0} 21:50:28.945506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17861): Launched 21:50:29.252384 run osmo-hlr_10.42.42.2(pid=17862): Launched 21:50:29.368461 run osmo-stp_10.42.42.5: Starting osmo-stp 21:50:29.895576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17864): Launched 21:50:30.199729 run osmo-stp_10.42.42.5(pid=17865): Launched 21:50:30.314543 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:50:30.851362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17867): Launched 21:50:30.996924 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:50:31.294094 run patchelf(pid=17868): Launched 21:50:31.489927 run osmo-stp_10.42.42.5(pid=17865): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17865)] 21:50:31.633714 run osmo-stp_10.42.42.5(pid=17865): stdout: | (launched: 2022-12-08_21:50:30.143907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:31.779626 run osmo-stp_10.42.42.5(pid=17865): stderr: | 20221208215030318 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215030318 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215030319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215030319 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215030320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215030320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215030320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:31.925424 run osmo-stp_10.42.42.5(pid=17865): stdout: | (launched: 2022-12-08_21:50:30.143907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:32.064536 run osmo-stp_10.42.42.5(pid=17865): stderr: | 20221208215030318 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215030318 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215030319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215030319 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215030320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215030320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215030320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:32.227104 run patchelf(pid=17868): Terminating (SIGINT) 21:50:32.411087 run patchelf(pid=17868): Terminated: ok {rc=0} 21:50:32.543941 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17865): Process ended prematurely: osmo-stp_10.42.42.5(pid=17865) [trial-2350↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17865)] [trial-2350↪gprs:sysmo↪iperf3.py:8] 21:50:32.554205 tst iperf3.py:8: Test FAILED (7.7 sec) 21:50:32.583690 run osmo-hlr_10.42.42.2(pid=17862): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17862)] 21:50:32.635506 run osmo-hlr_10.42.42.2(pid=17862): stdout: | (launched: 2022-12-08_21:50:29.196153) 21:50:32.689192 run osmo-hlr_10.42.42.2(pid=17862): stderr: | 20221208215029373 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215029373 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215029373 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215029373 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215029373 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215029374 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215029386 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215029395 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215029395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215029395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:50:32.743275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17857): Terminating (SIGTERM) 21:50:32.786718 run iperf3-srv_10.42.42.10(pid=17858): Terminating (SIGTERM) 21:50:32.829941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17861): Terminating (SIGTERM) 21:50:32.873879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17864): Terminating (SIGTERM) 21:50:32.917065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17867): Terminating (SIGTERM) 21:50:32.960509 --- ParallelTerminationStrategy: PID 17857 died... 21:50:32.981136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17857): Terminated: ok {rc=0} 21:50:33.029279 --- ParallelTerminationStrategy: PID 17858 died... 21:50:33.049360 run iperf3-srv_10.42.42.10(pid=17858): Terminated {rc=256} 21:50:33.097281 --- ParallelTerminationStrategy: PID 17861 died... 21:50:33.117598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17861): Terminated: ok {rc=0} 21:50:33.165513 --- ParallelTerminationStrategy: PID 17864 died... 21:50:33.185463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17864): Terminated: ok {rc=0} 21:50:33.233489 --- ParallelTerminationStrategy: PID 17867 died... 21:50:33.253494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17867): Terminated: ok {rc=0} 21:50:33.343501 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:sysmo iperf3m4.py ---------------------------------------------- 21:50:34.496754 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:34.508166 tst gprs:sysmo: Using 1 x bts (candidates: 1) 21:50:34.544881 tst iperf3m4.py: using LAC 16976 21:50:34.673627 tst iperf3m4.py: using RAC 146 21:50:34.796475 tst iperf3m4.py: using CellId 16976 21:50:34.918826 tst iperf3m4.py: using BVCI 16977 21:50:35.031810 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:35.042573 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:35.053152 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:35.063640 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:35.074017 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:35.084072 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:35.094437 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:35.104604 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:35.115059 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:50:35.232557 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:50:35.351748 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:50:35.470871 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:50:35.586208 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:50:35.790654 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:36.097705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17869): Launched 21:50:36.363822 run iperf3-srv_10.42.42.10(pid=17870): Launched 21:50:36.479265 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:50:36.684550 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:36.993172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17871): Launched 21:50:37.259804 run iperf3-srv_10.42.42.10(pid=17872): Launched 21:50:37.374048 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:50:37.579152 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:37.886133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17873): Launched 21:50:38.151811 run iperf3-srv_10.42.42.10(pid=17874): Launched 21:50:38.266180 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:50:38.469593 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:38.776037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17875): Launched 21:50:39.056938 run iperf3-srv_10.42.42.10(pid=17876): Launched 21:50:39.171267 tst iperf3m4.py:8: start network... 21:50:39.375034 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:50:39.849874 run create_hlr_db(pid=17877): Launched 21:50:39.973301 bus /gobi_6: Setting Powered False 21:50:41.034539 run create_hlr_db(pid=17877): Terminated: ok {rc=0} 21:50:41.480008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17879): Launched 21:50:41.807219 run osmo-hlr_10.42.42.2(pid=17880): Launched 21:50:41.931600 run osmo-stp_10.42.42.5: Starting osmo-stp 21:50:42.499587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17882): Launched 21:50:42.825651 run osmo-stp_10.42.42.5(pid=17883): Launched 21:50:42.950621 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:50:43.517727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17885): Launched 21:50:43.643657 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:50:43.922069 run patchelf(pid=17886): Launched 21:50:44.104654 run osmo-stp_10.42.42.5(pid=17883): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17883)] 21:50:44.243760 run osmo-stp_10.42.42.5(pid=17883): stdout: | (launched: 2022-12-08_21:50:42.765984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:44.384192 run osmo-stp_10.42.42.5(pid=17883): stderr: | 20221208215042957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215042957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215042957 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215042958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215042960 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215042960 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215042960 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:44.524538 run osmo-stp_10.42.42.5(pid=17883): stdout: | (launched: 2022-12-08_21:50:42.765984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:44.659710 run osmo-stp_10.42.42.5(pid=17883): stderr: | 20221208215042957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215042957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215042957 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215042958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215042960 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215042960 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215042960 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:44.819878 run patchelf(pid=17886): Terminating (SIGINT) 21:50:45.003682 run patchelf(pid=17886): Terminated: ok {rc=0} 21:50:45.136228 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17883): Process ended prematurely: osmo-stp_10.42.42.5(pid=17883) [trial-2350↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17883)] [trial-2350↪gprs:sysmo↪iperf3m4.py:8] 21:50:45.146481 tst iperf3m4.py:8: Test FAILED (10.7 sec) 21:50:45.176420 run osmo-hlr_10.42.42.2(pid=17880): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17880)] 21:50:45.228154 run osmo-hlr_10.42.42.2(pid=17880): stdout: | (launched: 2022-12-08_21:50:41.747509) 21:50:45.282162 run osmo-hlr_10.42.42.2(pid=17880): stderr: | 20221208215041948 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215041948 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215041948 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215041948 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215041948 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215041948 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215041960 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215041969 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215041969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215041969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:50:45.336241 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17869): Terminating (SIGTERM) 21:50:45.379267 run iperf3-srv_10.42.42.10(pid=17870): Terminating (SIGTERM) 21:50:45.422238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17871): Terminating (SIGTERM) 21:50:45.465276 run iperf3-srv_10.42.42.10(pid=17872): Terminating (SIGTERM) 21:50:45.508307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17873): Terminating (SIGTERM) 21:50:45.551503 run iperf3-srv_10.42.42.10(pid=17874): Terminating (SIGTERM) 21:50:45.594723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17875): Terminating (SIGTERM) 21:50:45.637792 run iperf3-srv_10.42.42.10(pid=17876): Terminating (SIGTERM) 21:50:45.680684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17879): Terminating (SIGTERM) 21:50:45.724009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17882): Terminating (SIGTERM) 21:50:45.767059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17885): Terminating (SIGTERM) 21:50:45.810371 --- ParallelTerminationStrategy: PID 17869 died... 21:50:45.831232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17869): Terminated: ok {rc=0} 21:50:45.887045 --- ParallelTerminationStrategy: PID 17870 died... 21:50:45.919617 run iperf3-srv_10.42.42.10(pid=17870): Terminated {rc=256} 21:50:45.967907 --- ParallelTerminationStrategy: PID 17871 died... 21:50:45.988596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17871): Terminated: ok {rc=0} 21:50:46.037759 --- ParallelTerminationStrategy: PID 17872 died... 21:50:46.058290 run iperf3-srv_10.42.42.10(pid=17872): Terminated {rc=256} 21:50:46.107519 --- ParallelTerminationStrategy: PID 17873 died... 21:50:46.128055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17873): Terminated: ok {rc=0} 21:50:46.177171 --- ParallelTerminationStrategy: PID 17874 died... 21:50:46.197693 run iperf3-srv_10.42.42.10(pid=17874): Terminated {rc=256} 21:50:46.246103 --- ParallelTerminationStrategy: PID 17875 died... 21:50:46.266584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17875): Terminated: ok {rc=0} 21:50:46.315277 --- ParallelTerminationStrategy: PID 17876 died... 21:50:46.335714 run iperf3-srv_10.42.42.10(pid=17876): Terminated {rc=256} 21:50:46.384405 --- ParallelTerminationStrategy: PID 17879 died... 21:50:46.405050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17879): Terminated: ok {rc=0} 21:50:46.453782 --- ParallelTerminationStrategy: PID 17882 died... 21:50:46.474320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17882): Terminated: ok {rc=0} 21:50:46.523058 --- ParallelTerminationStrategy: PID 17885 died... 21:50:46.543606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17885): Terminated: ok {rc=0} 21:50:46.635007 bus /gobi_4: Setting Powered False 21:50:47.736136 bus /gobi_4: Setting Powered False 21:50:48.853912 bus /gobi_1: Setting Powered False 21:50:49.954212 bus /gobi_1: Setting Powered False 21:50:51.071541 bus /gobi_0: Setting Powered False 21:50:52.170741 bus /gobi_0: Setting Powered False 21:50:53.291000 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:sysmo ping.py ---------------------------------------------- 21:50:54.396009 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:54.407056 tst gprs:sysmo: Using 1 x bts (candidates: 1) 21:50:54.443888 tst ping.py: using LAC 16977 21:50:54.564781 tst ping.py: using RAC 147 21:50:54.685179 tst ping.py: using CellId 16977 21:50:54.812870 tst ping.py: using BVCI 16978 21:50:54.930261 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:54.941389 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:54.952645 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:54.963902 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:54.974938 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:54.985859 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:54.996821 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:55.007931 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:50:55.121285 tst ping.py:19: start network... 21:50:55.321714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:50:55.786527 run create_hlr_db(pid=17887): Launched 21:50:55.909515 bus /gobi_6: Setting Powered False 21:50:56.969844 run create_hlr_db(pid=17887): Terminated: ok {rc=0} 21:50:57.408998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17889): Launched 21:50:57.732059 run osmo-hlr_10.42.42.2(pid=17890): Launched 21:50:57.853805 run osmo-stp_10.42.42.5: Starting osmo-stp 21:50:58.405925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17892): Launched 21:50:58.725883 run osmo-stp_10.42.42.5(pid=17893): Launched 21:50:58.846788 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:50:59.400344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17895): Launched 21:50:59.523194 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:50:59.795766 run patchelf(pid=17896): Launched 21:50:59.974642 run osmo-stp_10.42.42.5(pid=17893): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17893)] 21:51:00.112139 run osmo-stp_10.42.42.5(pid=17893): stdout: | (launched: 2022-12-08_21:50:58.667601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:00.250967 run osmo-stp_10.42.42.5(pid=17893): stderr: | 20221208215058860 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215058861 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215058861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215058861 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215058862 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215058862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215058862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:00.389944 run osmo-stp_10.42.42.5(pid=17893): stdout: | (launched: 2022-12-08_21:50:58.667601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:00.522351 run osmo-stp_10.42.42.5(pid=17893): stderr: | 20221208215058860 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215058861 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215058861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215058861 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215058862 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215058862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215058862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:00.679224 run patchelf(pid=17896): Terminating (SIGINT) 21:51:00.862080 run patchelf(pid=17896): Terminated: ok {rc=0} 21:51:01.009541 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17893): Process ended prematurely: osmo-stp_10.42.42.5(pid=17893) [trial-2350↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17893)] [trial-2350↪gprs:sysmo↪ping.py:22] 21:51:01.020002 tst ping.py:22: Test FAILED (6.6 sec) 21:51:01.053389 run osmo-hlr_10.42.42.2(pid=17890): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17890)] 21:51:01.107944 run osmo-hlr_10.42.42.2(pid=17890): stdout: | (launched: 2022-12-08_21:50:57.673552) 21:51:01.163911 run osmo-hlr_10.42.42.2(pid=17890): stderr: | 20221208215057874 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215057874 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215057874 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215057874 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215057874 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215057874 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215057891 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215057900 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215057901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215057901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:51:01.220060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17889): Terminating (SIGTERM) 21:51:01.265358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17892): Terminating (SIGTERM) 21:51:01.310650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17895): Terminating (SIGTERM) 21:51:01.356318 --- ParallelTerminationStrategy: PID 17889 died... 21:51:01.377496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17889): Terminated: ok {rc=0} 21:51:01.428492 --- ParallelTerminationStrategy: PID 17892 died... 21:51:01.449633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17892): Terminated: ok {rc=0} 21:51:01.500729 --- ParallelTerminationStrategy: PID 17895 died... 21:51:01.521845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17895): Terminated: ok {rc=0} 21:51:01.628007 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 21:51:02.717340 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:02.728437 tst gprs:sysmo: Using 1 x bts (candidates: 1) 21:51:02.776157 tst ping_idle_ping.py: using LAC 16978 21:51:02.897908 tst ping_idle_ping.py: using RAC 148 21:51:03.017838 tst ping_idle_ping.py: using CellId 16978 21:51:03.139675 tst ping_idle_ping.py: using BVCI 16979 21:51:03.250142 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:03.260596 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:03.270992 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:03.281297 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:03.291455 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:03.301713 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:03.312501 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:03.322933 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:51:03.448683 tst ping_idle_ping.py:24: start network... 21:51:03.666091 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:51:04.165231 run create_hlr_db(pid=17897): Launched 21:51:04.287909 bus /gobi_6: Setting Powered False 21:51:05.351390 run create_hlr_db(pid=17897): Terminated: ok {rc=0} 21:51:05.799613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17899): Launched 21:51:06.120071 run osmo-hlr_10.42.42.2(pid=17900): Launched 21:51:06.243402 run osmo-stp_10.42.42.5: Starting osmo-stp 21:51:06.801233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17902): Launched 21:51:07.121772 run osmo-stp_10.42.42.5(pid=17903): Launched 21:51:07.245168 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:51:07.804170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17905): Launched 21:51:07.927502 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:51:08.200502 run patchelf(pid=17906): Launched 21:51:08.379220 run osmo-stp_10.42.42.5(pid=17903): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17903)] 21:51:08.516214 run osmo-stp_10.42.42.5(pid=17903): stdout: | (launched: 2022-12-08_21:51:07.063311) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:08.654974 run osmo-stp_10.42.42.5(pid=17903): stderr: | 20221208215107254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215107254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215107254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215107254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215107255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215107255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215107255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:08.793725 run osmo-stp_10.42.42.5(pid=17903): stdout: | (launched: 2022-12-08_21:51:07.063311) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:08.926507 run osmo-stp_10.42.42.5(pid=17903): stderr: | 20221208215107254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215107254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215107254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215107254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215107255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215107255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215107255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:09.083519 run patchelf(pid=17906): Terminating (SIGINT) 21:51:09.265126 run patchelf(pid=17906): Terminated: ok {rc=0} 21:51:09.395665 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17903): Process ended prematurely: osmo-stp_10.42.42.5(pid=17903) [trial-2350↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17903)] [trial-2350↪gprs:sysmo↪ping_idle_ping.py:27] 21:51:09.405088 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 21:51:09.433941 run osmo-hlr_10.42.42.2(pid=17900): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17900)] 21:51:09.484833 run osmo-hlr_10.42.42.2(pid=17900): stdout: | (launched: 2022-12-08_21:51:06.061588) 21:51:09.537454 run osmo-hlr_10.42.42.2(pid=17900): stderr: | 20221208215106258 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215106258 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215106258 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215106258 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215106258 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215106258 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215106271 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215106279 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215106279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215106279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:51:09.590557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17899): Terminating (SIGTERM) 21:51:09.633049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17902): Terminating (SIGTERM) 21:51:09.676184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17905): Terminating (SIGTERM) 21:51:09.718961 --- ParallelTerminationStrategy: PID 17899 died... 21:51:09.739174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17899): Terminated: ok {rc=0} 21:51:09.786507 --- ParallelTerminationStrategy: PID 17902 died... 21:51:09.806286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17902): Terminated: ok {rc=0} 21:51:09.853480 --- ParallelTerminationStrategy: PID 17905 died... 21:51:09.873161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17905): Terminated: ok {rc=0} 21:51:09.962366 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 21:51:11.249240 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:51:11.255242 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 21:51:11.276930 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 21:51:11.316519 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 21:51:11.404335 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 21:51:11.425254 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 21:51:11.464382 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 21:51:12.057182 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 21:51:12.109955 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:12.121381 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:51:12.159481 tst cs_paging_gprs_active.py: using LAC 16979 21:51:12.289707 tst cs_paging_gprs_active.py: using RAC 149 21:51:12.415393 tst cs_paging_gprs_active.py: using CellId 16979 21:51:12.538742 tst cs_paging_gprs_active.py: using BVCI 16980 21:51:12.651556 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:12.662575 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:12.673767 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:12.684656 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:12.695395 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:12.706283 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:12.717220 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:12.727827 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:12.738870 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:51:12.854865 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:51:12.970783 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:51:13.175881 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:51:13.483298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17910): Launched 21:51:13.751391 run iperf3-srv_10.42.42.10(pid=17911): Launched 21:51:13.867094 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:51:14.071882 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:51:14.380314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17912): Launched 21:51:14.648447 run iperf3-srv_10.42.42.10(pid=17913): Launched 21:51:14.763886 tst cs_paging_gprs_active.py:38: start network... 21:51:14.969485 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:51:15.445623 run create_hlr_db(pid=17914): Launched 21:51:15.571525 bus /gobi_6: Setting Powered False 21:51:16.632586 run create_hlr_db(pid=17914): Terminated: ok {rc=0} 21:51:17.077126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17916): Launched 21:51:17.401471 run osmo-hlr_10.42.42.2(pid=17917): Launched 21:51:17.520234 run osmo-stp_10.42.42.5: Starting osmo-stp 21:51:18.046648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17919): Launched 21:51:18.353503 run osmo-stp_10.42.42.5(pid=17920): Launched 21:51:18.470787 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:51:19.001065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17922): Launched 21:51:19.118354 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:51:19.377470 run patchelf(pid=17923): Launched 21:51:19.548396 run osmo-stp_10.42.42.5(pid=17920): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17920)] 21:51:19.678816 run osmo-stp_10.42.42.5(pid=17920): stdout: | (launched: 2022-12-08_21:51:18.297472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:19.811401 run osmo-stp_10.42.42.5(pid=17920): stderr: | 20221208215118470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215118470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215118470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215118471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215118471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215118471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215118471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:19.943471 run osmo-stp_10.42.42.5(pid=17920): stdout: | (launched: 2022-12-08_21:51:18.297472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:20.070526 run osmo-stp_10.42.42.5(pid=17920): stderr: | 20221208215118470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215118470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215118470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215118471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215118471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215118471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215118471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:20.221414 run patchelf(pid=17923): Terminating (SIGINT) 21:51:20.394568 run patchelf(pid=17923): Terminated: ok {rc=0} 21:51:20.519043 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17920): Process ended prematurely: osmo-stp_10.42.42.5(pid=17920) [trial-2350↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17920)] [trial-2350↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 21:51:20.528534 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 21:51:20.556065 run osmo-hlr_10.42.42.2(pid=17917): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17917)] 21:51:20.604504 run osmo-hlr_10.42.42.2(pid=17917): stdout: | (launched: 2022-12-08_21:51:17.345470) 21:51:20.654886 run osmo-hlr_10.42.42.2(pid=17917): stderr: | 20221208215117523 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215117523 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215117523 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215117523 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215117523 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215117523 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215117535 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215117546 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215117546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215117546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:51:20.706531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17910): Terminating (SIGTERM) 21:51:20.747534 run iperf3-srv_10.42.42.10(pid=17911): Terminating (SIGTERM) 21:51:20.788195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17912): Terminating (SIGTERM) 21:51:20.829092 run iperf3-srv_10.42.42.10(pid=17913): Terminating (SIGTERM) 21:51:20.869637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17916): Terminating (SIGTERM) 21:51:20.910497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17919): Terminating (SIGTERM) 21:51:20.951255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17922): Terminating (SIGTERM) 21:51:20.992093 --- ParallelTerminationStrategy: PID 17910 died... 21:51:21.011612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17910): Terminated: ok {rc=0} 21:51:21.056814 --- ParallelTerminationStrategy: PID 17911 died... 21:51:21.076142 run iperf3-srv_10.42.42.10(pid=17911): Terminated {rc=256} 21:51:21.121296 --- ParallelTerminationStrategy: PID 17912 died... 21:51:21.140485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17912): Terminated: ok {rc=0} 21:51:21.185408 --- ParallelTerminationStrategy: PID 17913 died... 21:51:21.204044 run iperf3-srv_10.42.42.10(pid=17913): Terminated {rc=256} 21:51:21.248866 --- ParallelTerminationStrategy: PID 17916 died... 21:51:21.268163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17916): Terminated: ok {rc=0} 21:51:21.313216 --- ParallelTerminationStrategy: PID 17919 died... 21:51:21.332126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17919): Terminated: ok {rc=0} 21:51:21.377759 --- ParallelTerminationStrategy: PID 17922 died... 21:51:21.396764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17922): Terminated: ok {rc=0} 21:51:21.484392 bus /gobi_0: Setting Powered False 21:51:22.587309 bus /gobi_0: Setting Powered False 21:51:23.705661 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 21:51:24.855971 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:24.867689 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:51:24.906390 tst iperf3.py: using LAC 16980 21:51:25.034723 tst iperf3.py: using RAC 150 21:51:25.165364 tst iperf3.py: using CellId 16980 21:51:25.295387 tst iperf3.py: using BVCI 16981 21:51:25.415446 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:25.426646 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:25.437749 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:25.449066 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:25.460224 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:25.471334 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:25.482608 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:25.493762 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:25.504897 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:51:25.625401 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:51:25.830794 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:51:26.137811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17924): Launched 21:51:26.405318 run iperf3-srv_10.42.42.10(pid=17925): Launched 21:51:26.520168 tst iperf3.py:8: start network... 21:51:26.724539 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:51:27.197288 run create_hlr_db(pid=17926): Launched 21:51:27.322847 bus /gobi_6: Setting Powered False 21:51:28.383686 run create_hlr_db(pid=17926): Terminated: ok {rc=0} 21:51:28.831264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17928): Launched 21:51:29.159344 run osmo-hlr_10.42.42.2(pid=17929): Launched 21:51:29.284480 run osmo-stp_10.42.42.5: Starting osmo-stp 21:51:29.848684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17931): Launched 21:51:30.176047 run osmo-stp_10.42.42.5(pid=17932): Launched 21:51:30.300515 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:51:30.900072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17934): Launched 21:51:31.028528 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:51:31.302070 run patchelf(pid=17935): Launched 21:51:31.493461 run osmo-stp_10.42.42.5(pid=17932): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17932)] 21:51:31.627209 run osmo-stp_10.42.42.5(pid=17932): stdout: | (launched: 2022-12-08_21:51:30.116244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:31.763203 run osmo-stp_10.42.42.5(pid=17932): stderr: | 20221208215130313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215130313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215130313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215130313 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215130314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215130314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215130314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:31.900201 run osmo-stp_10.42.42.5(pid=17932): stdout: | (launched: 2022-12-08_21:51:30.116244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:32.029734 run osmo-stp_10.42.42.5(pid=17932): stderr: | 20221208215130313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215130313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215130313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215130313 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215130314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215130314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215130314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:32.182803 run patchelf(pid=17935): Terminating (SIGINT) 21:51:32.355736 run patchelf(pid=17935): Terminated: ok {rc=0} 21:51:32.480286 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17932): Process ended prematurely: osmo-stp_10.42.42.5(pid=17932) [trial-2350↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17932)] [trial-2350↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 21:51:32.489806 tst iperf3.py:8: Test FAILED (7.7 sec) 21:51:32.517525 run osmo-hlr_10.42.42.2(pid=17929): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17929)] 21:51:32.566782 run osmo-hlr_10.42.42.2(pid=17929): stdout: | (launched: 2022-12-08_21:51:29.099602) 21:51:32.617894 run osmo-hlr_10.42.42.2(pid=17929): stderr: | 20221208215129299 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215129299 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215129299 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215129299 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215129299 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215129299 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215129312 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215129320 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215129320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215129320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:51:32.669408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17924): Terminating (SIGTERM) 21:51:32.710266 run iperf3-srv_10.42.42.10(pid=17925): Terminating (SIGTERM) 21:51:32.750998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17928): Terminating (SIGTERM) 21:51:32.791956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17931): Terminating (SIGTERM) 21:51:32.833003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17934): Terminating (SIGTERM) 21:51:32.874098 --- ParallelTerminationStrategy: PID 17924 died... 21:51:32.893780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17924): Terminated: ok {rc=0} 21:51:32.939392 --- ParallelTerminationStrategy: PID 17925 died... 21:51:32.958323 run iperf3-srv_10.42.42.10(pid=17925): Terminated {rc=256} 21:51:33.003069 --- ParallelTerminationStrategy: PID 17928 died... 21:51:33.022045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17928): Terminated: ok {rc=0} 21:51:33.066944 --- ParallelTerminationStrategy: PID 17931 died... 21:51:33.085974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17931): Terminated: ok {rc=0} 21:51:33.131396 --- ParallelTerminationStrategy: PID 17934 died... 21:51:33.150521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17934): Terminated: ok {rc=0} 21:51:33.239006 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 21:51:34.392169 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:34.404114 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:51:34.445454 tst iperf3m4.py: using LAC 16981 21:51:34.572812 tst iperf3m4.py: using RAC 151 21:51:34.699968 tst iperf3m4.py: using CellId 16981 21:51:34.830530 tst iperf3m4.py: using BVCI 16982 21:51:34.951260 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:34.962585 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:34.973659 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:34.984794 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:34.995970 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:35.007099 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:35.018679 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:35.029987 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:35.041559 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:51:35.158401 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:51:35.274490 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:51:35.393181 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:51:35.513389 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:51:35.735001 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:51:36.065981 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17936): Launched 21:51:36.350981 run iperf3-srv_10.42.42.10(pid=17937): Launched 21:51:36.473872 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:51:36.695014 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:51:37.024260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17938): Launched 21:51:37.308883 run iperf3-srv_10.42.42.10(pid=17939): Launched 21:51:37.432117 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:51:37.652674 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:51:37.982233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17940): Launched 21:51:38.267059 run iperf3-srv_10.42.42.10(pid=17941): Launched 21:51:38.390159 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:51:38.611380 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:51:38.940766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17942): Launched 21:51:39.225992 run iperf3-srv_10.42.42.10(pid=17943): Launched 21:51:39.349066 tst iperf3m4.py:8: start network... 21:51:39.569642 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:51:40.072314 run create_hlr_db(pid=17944): Launched 21:51:40.198278 bus /gobi_6: Setting Powered False 21:51:41.260212 run create_hlr_db(pid=17944): Terminated: ok {rc=0} 21:51:41.687680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17946): Launched 21:51:41.993779 run osmo-hlr_10.42.42.2(pid=17947): Launched 21:51:42.110278 run osmo-stp_10.42.42.5: Starting osmo-stp 21:51:42.638317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17949): Launched 21:51:42.944463 run osmo-stp_10.42.42.5(pid=17950): Launched 21:51:43.060380 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:51:43.588185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17952): Launched 21:51:43.705285 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:51:43.963909 run patchelf(pid=17953): Launched 21:51:44.135302 run osmo-stp_10.42.42.5(pid=17950): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17950)] 21:51:44.265361 run osmo-stp_10.42.42.5(pid=17950): stdout: | (launched: 2022-12-08_21:51:42.888002) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:44.396746 run osmo-stp_10.42.42.5(pid=17950): stderr: | 20221208215143060 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215143060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215143060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215143061 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215143063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215143063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215143063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:44.529091 run osmo-stp_10.42.42.5(pid=17950): stdout: | (launched: 2022-12-08_21:51:42.888002) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:44.655434 run osmo-stp_10.42.42.5(pid=17950): stderr: | 20221208215143060 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215143060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215143060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215143061 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215143063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215143063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215143063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:44.804757 run patchelf(pid=17953): Terminating (SIGINT) 21:51:44.977554 run patchelf(pid=17953): Terminated: ok {rc=0} 21:51:45.101665 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17950): Process ended prematurely: osmo-stp_10.42.42.5(pid=17950) [trial-2350↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17950)] [trial-2350↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 21:51:45.111037 tst iperf3m4.py:8: Test FAILED (10.8 sec) 21:51:45.138730 run osmo-hlr_10.42.42.2(pid=17947): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17947)] 21:51:45.187495 run osmo-hlr_10.42.42.2(pid=17947): stdout: | (launched: 2022-12-08_21:51:41.937440) 21:51:45.238191 run osmo-hlr_10.42.42.2(pid=17947): stderr: | 20221208215142116 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215142116 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215142116 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215142116 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215142116 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215142116 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215142138 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215142147 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215142147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215142147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:51:45.289126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17936): Terminating (SIGTERM) 21:51:45.329603 run iperf3-srv_10.42.42.10(pid=17937): Terminating (SIGTERM) 21:51:45.370380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17938): Terminating (SIGTERM) 21:51:45.410921 run iperf3-srv_10.42.42.10(pid=17939): Terminating (SIGTERM) 21:51:45.451473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17940): Terminating (SIGTERM) 21:51:45.492121 run iperf3-srv_10.42.42.10(pid=17941): Terminating (SIGTERM) 21:51:45.532633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17942): Terminating (SIGTERM) 21:51:45.573458 run iperf3-srv_10.42.42.10(pid=17943): Terminating (SIGTERM) 21:51:45.614061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17946): Terminating (SIGTERM) 21:51:45.654906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17949): Terminating (SIGTERM) 21:51:45.695460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17952): Terminating (SIGTERM) 21:51:45.736191 --- ParallelTerminationStrategy: PID 17936 died... 21:51:45.755666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17936): Terminated: ok {rc=0} 21:51:45.800771 --- ParallelTerminationStrategy: PID 17937 died... 21:51:45.819864 run iperf3-srv_10.42.42.10(pid=17937): Terminated {rc=256} 21:51:45.873234 --- ParallelTerminationStrategy: PID 17938 died... 21:51:45.892773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17938): Terminated: ok {rc=0} 21:51:45.938651 --- ParallelTerminationStrategy: PID 17939 died... 21:51:45.958062 run iperf3-srv_10.42.42.10(pid=17939): Terminated {rc=256} 21:51:46.004869 --- ParallelTerminationStrategy: PID 17940 died... 21:51:46.024458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17940): Terminated: ok {rc=0} 21:51:46.070870 --- ParallelTerminationStrategy: PID 17941 died... 21:51:46.090538 run iperf3-srv_10.42.42.10(pid=17941): Terminated {rc=256} 21:51:46.136413 --- ParallelTerminationStrategy: PID 17942 died... 21:51:46.156045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17942): Terminated: ok {rc=0} 21:51:46.202129 --- ParallelTerminationStrategy: PID 17943 died... 21:51:46.221814 run iperf3-srv_10.42.42.10(pid=17943): Terminated {rc=256} 21:51:46.267929 --- ParallelTerminationStrategy: PID 17946 died... 21:51:46.287538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17946): Terminated: ok {rc=0} 21:51:46.333609 --- ParallelTerminationStrategy: PID 17949 died... 21:51:46.353318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17949): Terminated: ok {rc=0} 21:51:46.399621 --- ParallelTerminationStrategy: PID 17952 died... 21:51:46.419216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17952): Terminated: ok {rc=0} 21:51:46.505941 bus /gobi_4: Setting Powered False 21:51:47.604005 bus /gobi_4: Setting Powered False 21:51:48.721364 bus /gobi_1: Setting Powered False 21:51:49.823569 bus /gobi_1: Setting Powered False 21:51:50.941921 bus /gobi_0: Setting Powered False 21:51:52.043249 bus /gobi_0: Setting Powered False 21:51:53.162578 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 21:51:54.268221 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:54.280500 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:51:54.318935 tst ping.py: using LAC 16982 21:51:54.446369 tst ping.py: using RAC 152 21:51:54.574434 tst ping.py: using CellId 16982 21:51:54.703533 tst ping.py: using BVCI 16983 21:51:54.821033 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:54.832177 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:54.843270 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:54.854528 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:54.865603 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:54.876686 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:54.888037 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:54.899238 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:51:55.019848 tst ping.py:19: start network... 21:51:55.237168 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:51:55.734461 run create_hlr_db(pid=17954): Launched 21:51:55.856313 bus /gobi_6: Setting Powered False 21:51:56.920746 run create_hlr_db(pid=17954): Terminated: ok {rc=0} 21:51:57.369653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17956): Launched 21:51:57.690087 run osmo-hlr_10.42.42.2(pid=17957): Launched 21:51:57.812664 run osmo-stp_10.42.42.5: Starting osmo-stp 21:51:58.332121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17959): Launched 21:51:58.653286 run osmo-stp_10.42.42.5(pid=17960): Launched 21:51:58.775048 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:51:59.328410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17962): Launched 21:51:59.451093 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:51:59.722848 run patchelf(pid=17963): Launched 21:51:59.901935 run osmo-stp_10.42.42.5(pid=17960): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17960)] 21:52:00.039451 run osmo-stp_10.42.42.5(pid=17960): stdout: | (launched: 2022-12-08_21:51:58.594968) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:00.178655 run osmo-stp_10.42.42.5(pid=17960): stderr: | 20221208215158788 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215158788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215158788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215158789 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215158789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215158789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215158789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:00.317743 run osmo-stp_10.42.42.5(pid=17960): stdout: | (launched: 2022-12-08_21:51:58.594968) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:00.450630 run osmo-stp_10.42.42.5(pid=17960): stderr: | 20221208215158788 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215158788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215158788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215158789 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215158789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215158789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215158789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:00.607660 run patchelf(pid=17963): Terminating (SIGINT) 21:52:00.789110 run patchelf(pid=17963): Terminated: ok {rc=0} 21:52:00.944273 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17960): Process ended prematurely: osmo-stp_10.42.42.5(pid=17960) [trial-2350↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17960)] [trial-2350↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 21:52:00.955065 tst ping.py:22: Test FAILED (6.7 sec) 21:52:00.986841 run osmo-hlr_10.42.42.2(pid=17957): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17957)] 21:52:01.040546 run osmo-hlr_10.42.42.2(pid=17957): stdout: | (launched: 2022-12-08_21:51:57.631681) 21:52:01.095883 run osmo-hlr_10.42.42.2(pid=17957): stderr: | 20221208215157829 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215157829 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215157829 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215157829 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215157829 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215157829 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215157842 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215157850 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215157850 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215157850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:52:01.152076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17956): Terminating (SIGTERM) 21:52:01.197444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17959): Terminating (SIGTERM) 21:52:01.242479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17962): Terminating (SIGTERM) 21:52:01.288400 --- ParallelTerminationStrategy: PID 17956 died... 21:52:01.309307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17956): Terminated: ok {rc=0} 21:52:01.361743 --- ParallelTerminationStrategy: PID 17959 died... 21:52:01.382694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17959): Terminated: ok {rc=0} 21:52:01.433246 --- ParallelTerminationStrategy: PID 17962 died... 21:52:01.454172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17962): Terminated: ok {rc=0} 21:52:01.546634 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 21:52:02.637387 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:02.650381 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:52:02.690331 tst ping_idle_ping.py: using LAC 16983 21:52:02.810982 tst ping_idle_ping.py: using RAC 153 21:52:02.931419 tst ping_idle_ping.py: using CellId 16983 21:52:03.052710 tst ping_idle_ping.py: using BVCI 16984 21:52:03.163985 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:03.174880 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:03.185723 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:03.196265 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:03.206931 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:03.217480 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:03.228111 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:03.238761 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:52:03.363536 tst ping_idle_ping.py:24: start network... 21:52:03.579927 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:52:04.076583 run create_hlr_db(pid=17964): Launched 21:52:04.199885 bus /gobi_6: Setting Powered False 21:52:05.264511 run create_hlr_db(pid=17964): Terminated: ok {rc=0} 21:52:05.695867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17966): Launched 21:52:05.996566 run osmo-hlr_10.42.42.2(pid=17967): Launched 21:52:06.110727 run osmo-stp_10.42.42.5: Starting osmo-stp 21:52:06.629428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17969): Launched 21:52:06.930316 run osmo-stp_10.42.42.5(pid=17970): Launched 21:52:07.044422 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:52:07.564552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17972): Launched 21:52:07.680021 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:52:07.934418 run patchelf(pid=17973): Launched 21:52:08.101685 run osmo-stp_10.42.42.5(pid=17970): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17970)] 21:52:08.230554 run osmo-stp_10.42.42.5(pid=17970): stdout: | (launched: 2022-12-08_21:52:06.875287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:08.359739 run osmo-stp_10.42.42.5(pid=17970): stderr: | 20221208215207045 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215207045 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215207045 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215207046 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215207046 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215207046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215207046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:08.489516 run osmo-stp_10.42.42.5(pid=17970): stdout: | (launched: 2022-12-08_21:52:06.875287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:08.613216 run osmo-stp_10.42.42.5(pid=17970): stderr: | 20221208215207045 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215207045 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215207045 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215207046 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215207046 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215207046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215207046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:08.759680 run patchelf(pid=17973): Terminating (SIGINT) 21:52:08.928705 run patchelf(pid=17973): Terminated: ok {rc=0} 21:52:09.051067 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17970): Process ended prematurely: osmo-stp_10.42.42.5(pid=17970) [trial-2350↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17970)] [trial-2350↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 21:52:09.060008 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 21:52:09.086842 run osmo-hlr_10.42.42.2(pid=17967): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17967)] 21:52:09.134929 run osmo-hlr_10.42.42.2(pid=17967): stdout: | (launched: 2022-12-08_21:52:05.941395) 21:52:09.185224 run osmo-hlr_10.42.42.2(pid=17967): stderr: | 20221208215206116 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215206116 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215206116 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215206116 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215206116 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215206116 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215206129 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215206139 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215206139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215206139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:52:09.235380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17966): Terminating (SIGTERM) 21:52:09.275520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17969): Terminating (SIGTERM) 21:52:09.315906 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17972): Terminating (SIGTERM) 21:52:09.356534 --- ParallelTerminationStrategy: PID 17966 died... 21:52:09.376140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17966): Terminated: ok {rc=0} 21:52:09.421781 --- ParallelTerminationStrategy: PID 17969 died... 21:52:09.441140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17969): Terminated: ok {rc=0} 21:52:09.486175 --- ParallelTerminationStrategy: PID 17972 died... 21:52:09.505270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17972): Terminated: ok {rc=0} 21:52:09.589944 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 21:52:10.878271 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:52:10.885631 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 21:52:10.906048 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 21:52:10.944059 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 21:52:11.029441 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 21:52:11.049805 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 21:52:11.087511 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 21:52:11.680556 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 21:52:11.729752 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:11.740443 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:52:11.796019 tst cs_paging_gprs_active.py: using LAC 16984 21:52:11.918086 tst cs_paging_gprs_active.py: using RAC 154 21:52:12.040173 tst cs_paging_gprs_active.py: using CellId 16984 21:52:12.161698 tst cs_paging_gprs_active.py: using BVCI 16985 21:52:12.272798 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:12.283768 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:12.294426 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:12.305028 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:12.315523 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:12.326106 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:12.336717 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:12.347676 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:12.358395 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:52:12.478555 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:52:12.595696 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:52:12.801467 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:52:13.108242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17978): Launched 21:52:13.374725 run iperf3-srv_10.42.42.10(pid=17979): Launched 21:52:13.488920 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:52:13.692553 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:52:13.998849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17980): Launched 21:52:14.265420 run iperf3-srv_10.42.42.10(pid=17981): Launched 21:52:14.380507 tst cs_paging_gprs_active.py:38: start network... 21:52:14.584857 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:52:15.060321 run create_hlr_db(pid=17982): Launched 21:52:15.191365 bus /gobi_6: Setting Powered False 21:52:16.254269 run create_hlr_db(pid=17982): Terminated: ok {rc=0} 21:52:16.698683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17984): Launched 21:52:17.033693 run osmo-hlr_10.42.42.2(pid=17985): Launched 21:52:17.174227 run osmo-stp_10.42.42.5: Starting osmo-stp 21:52:17.726953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17987): Launched 21:52:18.033115 run osmo-stp_10.42.42.5(pid=17988): Launched 21:52:18.148863 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:52:18.676218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17990): Launched 21:52:18.794032 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:52:19.052356 run patchelf(pid=17991): Launched 21:52:19.222628 run osmo-stp_10.42.42.5(pid=17988): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17988)] 21:52:19.352172 run osmo-stp_10.42.42.5(pid=17988): stdout: | (launched: 2022-12-08_21:52:17.977090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:19.483758 run osmo-stp_10.42.42.5(pid=17988): stderr: | 20221208215218149 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215218149 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215218150 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215218150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215218151 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215218151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215218151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:19.615546 run osmo-stp_10.42.42.5(pid=17988): stdout: | (launched: 2022-12-08_21:52:17.977090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:19.741997 run osmo-stp_10.42.42.5(pid=17988): stderr: | 20221208215218149 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215218149 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215218150 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215218150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215218151 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215218151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215218151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:19.891590 run patchelf(pid=17991): Terminating (SIGINT) 21:52:20.063887 run patchelf(pid=17991): Terminated: ok {rc=0} 21:52:20.188287 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17988): Process ended prematurely: osmo-stp_10.42.42.5(pid=17988) [trial-2350↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17988)] [trial-2350↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 21:52:20.197688 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 21:52:20.225185 run osmo-hlr_10.42.42.2(pid=17985): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17985)] 21:52:20.274790 run osmo-hlr_10.42.42.2(pid=17985): stdout: | (launched: 2022-12-08_21:52:16.962684) 21:52:20.325192 run osmo-hlr_10.42.42.2(pid=17985): stderr: | 20221208215217277 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215217277 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215217277 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215217277 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215217277 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215217277 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215217292 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215217302 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215217302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215217302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:52:20.375669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17978): Terminating (SIGTERM) 21:52:20.415892 run iperf3-srv_10.42.42.10(pid=17979): Terminating (SIGTERM) 21:52:20.455909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17980): Terminating (SIGTERM) 21:52:20.496044 run iperf3-srv_10.42.42.10(pid=17981): Terminating (SIGTERM) 21:52:20.536057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17984): Terminating (SIGTERM) 21:52:20.576141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17987): Terminating (SIGTERM) 21:52:20.616274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17990): Terminating (SIGTERM) 21:52:20.656623 --- ParallelTerminationStrategy: PID 17978 died... 21:52:20.675891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17978): Terminated: ok {rc=0} 21:52:20.720499 --- ParallelTerminationStrategy: PID 17979 died... 21:52:20.739269 run iperf3-srv_10.42.42.10(pid=17979): Terminated {rc=256} 21:52:20.783542 --- ParallelTerminationStrategy: PID 17980 died... 21:52:20.802282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17980): Terminated: ok {rc=0} 21:52:20.846489 --- ParallelTerminationStrategy: PID 17981 died... 21:52:20.865213 run iperf3-srv_10.42.42.10(pid=17981): Terminated {rc=256} 21:52:20.909429 --- ParallelTerminationStrategy: PID 17984 died... 21:52:20.928183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17984): Terminated: ok {rc=0} 21:52:20.972525 --- ParallelTerminationStrategy: PID 17987 died... 21:52:20.991367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17987): Terminated: ok {rc=0} 21:52:21.035795 --- ParallelTerminationStrategy: PID 17990 died... 21:52:21.054476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17990): Terminated: ok {rc=0} 21:52:21.140522 bus /gobi_0: Setting Powered False 21:52:22.239666 bus /gobi_0: Setting Powered False 21:52:23.354249 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 21:52:24.504340 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:24.516011 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:52:24.576793 tst iperf3.py: using LAC 16985 21:52:24.707651 tst iperf3.py: using RAC 155 21:52:24.837945 tst iperf3.py: using CellId 16985 21:52:24.969719 tst iperf3.py: using BVCI 16986 21:52:25.081744 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:25.092575 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:25.103392 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:25.113982 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:25.124421 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:25.135046 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:25.145830 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:25.156256 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:25.166953 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:52:25.285774 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:52:25.507286 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:52:25.836467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17992): Launched 21:52:26.121845 run iperf3-srv_10.42.42.10(pid=17993): Launched 21:52:26.245447 tst iperf3.py:8: start network... 21:52:26.467008 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:52:26.974872 run create_hlr_db(pid=17994): Launched 21:52:27.100307 bus /gobi_6: Setting Powered False 21:52:28.165976 run create_hlr_db(pid=17994): Terminated: ok {rc=0} 21:52:28.603100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17996): Launched 21:52:28.908802 run osmo-hlr_10.42.42.2(pid=17997): Launched 21:52:29.025211 run osmo-stp_10.42.42.5: Starting osmo-stp 21:52:29.553103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17999): Launched 21:52:29.858705 run osmo-stp_10.42.42.5(pid=18000): Launched 21:52:29.974924 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:52:30.501675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18002): Launched 21:52:30.619835 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:52:30.881654 run patchelf(pid=18003): Launched 21:52:31.099465 run osmo-stp_10.42.42.5(pid=18000): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18000)] 21:52:31.243898 run osmo-stp_10.42.42.5(pid=18000): stdout: | (launched: 2022-12-08_21:52:29.802947) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:31.390987 run osmo-stp_10.42.42.5(pid=18000): stderr: | 20221208215229975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215229975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215229975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215229976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215229976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215229976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215229977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:31.537169 run osmo-stp_10.42.42.5(pid=18000): stdout: | (launched: 2022-12-08_21:52:29.802947) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:31.678683 run osmo-stp_10.42.42.5(pid=18000): stderr: | 20221208215229975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215229975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215229975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215229976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215229976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215229976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215229977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:31.843893 run patchelf(pid=18003): Terminating (SIGINT) 21:52:32.050207 run patchelf(pid=18003): Terminated: ok {rc=0} 21:52:32.189345 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18000): Process ended prematurely: osmo-stp_10.42.42.5(pid=18000) [trial-2350↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18000)] [trial-2350↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 21:52:32.200168 tst iperf3.py:8: Test FAILED (7.7 sec) 21:52:32.231980 run osmo-hlr_10.42.42.2(pid=17997): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17997)] 21:52:32.284214 run osmo-hlr_10.42.42.2(pid=17997): stdout: | (launched: 2022-12-08_21:52:28.852220) 21:52:32.338152 run osmo-hlr_10.42.42.2(pid=17997): stderr: | 20221208215229028 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215229028 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215229028 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215229028 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215229028 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215229028 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215229042 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215229050 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215229051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215229051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:52:32.392619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17992): Terminating (SIGTERM) 21:52:32.436537 run iperf3-srv_10.42.42.10(pid=17993): Terminating (SIGTERM) 21:52:32.480084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17996): Terminating (SIGTERM) 21:52:32.523701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17999): Terminating (SIGTERM) 21:52:32.567390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18002): Terminating (SIGTERM) 21:52:32.611515 --- ParallelTerminationStrategy: PID 17992 died... 21:52:32.632181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17992): Terminated: ok {rc=0} 21:52:32.681411 --- ParallelTerminationStrategy: PID 17993 died... 21:52:32.701438 run iperf3-srv_10.42.42.10(pid=17993): Terminated {rc=256} 21:52:32.750359 --- ParallelTerminationStrategy: PID 17996 died... 21:52:32.770418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17996): Terminated: ok {rc=0} 21:52:32.819130 --- ParallelTerminationStrategy: PID 17999 died... 21:52:32.839105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17999): Terminated: ok {rc=0} 21:52:32.888137 --- ParallelTerminationStrategy: PID 18002 died... 21:52:32.908371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18002): Terminated: ok {rc=0} 21:52:33.000255 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 21:52:34.153101 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:34.165615 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:52:34.223998 tst iperf3m4.py: using LAC 16986 21:52:34.354664 tst iperf3m4.py: using RAC 156 21:52:34.485402 tst iperf3m4.py: using CellId 16986 21:52:34.614188 tst iperf3m4.py: using BVCI 16987 21:52:34.734518 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:34.746087 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:34.757324 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:34.768734 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:34.780140 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:34.791575 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:34.803236 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:34.814723 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:34.826484 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:52:34.946222 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:52:35.065878 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:52:35.180466 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:52:35.301932 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:52:35.523403 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:52:35.854636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18010): Launched 21:52:36.140113 run iperf3-srv_10.42.42.10(pid=18011): Launched 21:52:36.263702 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:52:36.485070 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:52:36.814302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18012): Launched 21:52:37.099337 run iperf3-srv_10.42.42.10(pid=18013): Launched 21:52:37.222920 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:52:37.443451 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:52:37.772782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18014): Launched 21:52:38.057166 run iperf3-srv_10.42.42.10(pid=18015): Launched 21:52:38.179985 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:52:38.400866 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:52:38.730762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18016): Launched 21:52:39.015198 run iperf3-srv_10.42.42.10(pid=18017): Launched 21:52:39.137785 tst iperf3m4.py:8: start network... 21:52:39.359217 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:52:39.866370 run create_hlr_db(pid=18018): Launched 21:52:39.990812 bus /gobi_6: Setting Powered False 21:52:41.055947 run create_hlr_db(pid=18018): Terminated: ok {rc=0} 21:52:41.510591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18020): Launched 21:52:41.837638 run osmo-hlr_10.42.42.2(pid=18021): Launched 21:52:41.963111 run osmo-stp_10.42.42.5: Starting osmo-stp 21:52:42.527287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18023): Launched 21:52:42.853494 run osmo-stp_10.42.42.5(pid=18024): Launched 21:52:42.978364 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:52:43.544783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18026): Launched 21:52:43.669636 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:52:43.946067 run patchelf(pid=18027): Launched 21:52:44.127931 run osmo-stp_10.42.42.5(pid=18024): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18024)] 21:52:44.267387 run osmo-stp_10.42.42.5(pid=18024): stdout: | (launched: 2022-12-08_21:52:42.794136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:44.407837 run osmo-stp_10.42.42.5(pid=18024): stderr: | 20221208215242987 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215242987 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215242987 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215242988 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215242988 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215242988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215242988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:44.548523 run osmo-stp_10.42.42.5(pid=18024): stdout: | (launched: 2022-12-08_21:52:42.794136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:44.683496 run osmo-stp_10.42.42.5(pid=18024): stderr: | 20221208215242987 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215242987 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215242987 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215242988 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215242988 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215242988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215242988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:44.843650 run patchelf(pid=18027): Terminating (SIGINT) 21:52:45.027435 run patchelf(pid=18027): Terminated: ok {rc=0} 21:52:45.160001 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18024): Process ended prematurely: osmo-stp_10.42.42.5(pid=18024) [trial-2350↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18024)] [trial-2350↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 21:52:45.170632 tst iperf3m4.py:8: Test FAILED (11.1 sec) 21:52:45.200110 run osmo-hlr_10.42.42.2(pid=18021): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18021)] 21:52:45.252126 run osmo-hlr_10.42.42.2(pid=18021): stdout: | (launched: 2022-12-08_21:52:41.778161) 21:52:45.305523 run osmo-hlr_10.42.42.2(pid=18021): stderr: | 20221208215241976 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215241976 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215241976 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215241976 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215241976 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215241976 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215241989 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215241998 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215241998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215241998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:52:45.359208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18010): Terminating (SIGTERM) 21:52:45.402163 run iperf3-srv_10.42.42.10(pid=18011): Terminating (SIGTERM) 21:52:45.445097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18012): Terminating (SIGTERM) 21:52:45.488276 run iperf3-srv_10.42.42.10(pid=18013): Terminating (SIGTERM) 21:52:45.531430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18014): Terminating (SIGTERM) 21:52:45.574377 run iperf3-srv_10.42.42.10(pid=18015): Terminating (SIGTERM) 21:52:45.617156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18016): Terminating (SIGTERM) 21:52:45.660052 run iperf3-srv_10.42.42.10(pid=18017): Terminating (SIGTERM) 21:52:45.702939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18020): Terminating (SIGTERM) 21:52:45.745985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18023): Terminating (SIGTERM) 21:52:45.788927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18026): Terminating (SIGTERM) 21:52:45.832560 --- ParallelTerminationStrategy: PID 18010 died... 21:52:45.853302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18010): Terminated: ok {rc=0} 21:52:45.903050 --- ParallelTerminationStrategy: PID 18011 died... 21:52:45.925209 run iperf3-srv_10.42.42.10(pid=18011): Terminated {rc=256} 21:52:45.981282 --- ParallelTerminationStrategy: PID 18012 died... 21:52:46.002061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18012): Terminated: ok {rc=0} 21:52:46.050352 --- ParallelTerminationStrategy: PID 18013 died... 21:52:46.079596 run iperf3-srv_10.42.42.10(pid=18013): Terminated {rc=256} 21:52:46.127828 --- ParallelTerminationStrategy: PID 18014 died... 21:52:46.148184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18014): Terminated: ok {rc=0} 21:52:46.196895 --- ParallelTerminationStrategy: PID 18015 died... 21:52:46.217087 run iperf3-srv_10.42.42.10(pid=18015): Terminated {rc=256} 21:52:46.266931 --- ParallelTerminationStrategy: PID 18016 died... 21:52:46.287295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18016): Terminated: ok {rc=0} 21:52:46.336125 --- ParallelTerminationStrategy: PID 18017 died... 21:52:46.356598 run iperf3-srv_10.42.42.10(pid=18017): Terminated {rc=256} 21:52:46.406870 --- ParallelTerminationStrategy: PID 18020 died... 21:52:46.427187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18020): Terminated: ok {rc=0} 21:52:46.475925 --- ParallelTerminationStrategy: PID 18023 died... 21:52:46.495968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18023): Terminated: ok {rc=0} 21:52:46.544108 --- ParallelTerminationStrategy: PID 18026 died... 21:52:46.564265 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18026): Terminated: ok {rc=0} 21:52:46.654651 bus /gobi_4: Setting Powered False 21:52:47.753587 bus /gobi_4: Setting Powered False 21:52:48.870130 bus /gobi_1: Setting Powered False 21:52:49.970243 bus /gobi_1: Setting Powered False 21:52:51.086988 bus /gobi_0: Setting Powered False 21:52:52.187951 bus /gobi_0: Setting Powered False 21:52:53.307111 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 21:52:54.411820 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:54.424086 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:52:54.484227 tst ping.py: using LAC 16987 21:52:54.614458 tst ping.py: using RAC 157 21:52:54.747065 tst ping.py: using CellId 16987 21:52:54.873741 tst ping.py: using BVCI 16988 21:52:54.991836 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:55.003237 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:55.014393 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:55.026400 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:55.038200 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:55.050050 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:55.062136 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:55.073844 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:52:55.189666 tst ping.py:19: start network... 21:52:55.390894 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:52:55.856391 run create_hlr_db(pid=18028): Launched 21:52:55.979817 bus /gobi_6: Setting Powered False 21:52:57.039850 run create_hlr_db(pid=18028): Terminated: ok {rc=0} 21:52:57.460405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18030): Launched 21:52:57.761050 run osmo-hlr_10.42.42.2(pid=18031): Launched 21:52:57.874217 run osmo-stp_10.42.42.5: Starting osmo-stp 21:52:58.397800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18033): Launched 21:52:58.696753 run osmo-stp_10.42.42.5(pid=18034): Launched 21:52:58.809882 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:52:59.325285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18036): Launched 21:52:59.439306 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:52:59.691850 run patchelf(pid=18037): Launched 21:52:59.858312 run osmo-stp_10.42.42.5(pid=18034): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18034)] 21:52:59.985089 run osmo-stp_10.42.42.5(pid=18034): stdout: | (launched: 2022-12-08_21:52:58.642017) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:00.114055 run osmo-stp_10.42.42.5(pid=18034): stderr: | 20221208215258813 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215258813 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215258813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215258814 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215258814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215258814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215258814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:00.243072 run osmo-stp_10.42.42.5(pid=18034): stdout: | (launched: 2022-12-08_21:52:58.642017) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:00.365955 run osmo-stp_10.42.42.5(pid=18034): stderr: | 20221208215258813 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215258813 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215258813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215258814 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215258814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215258814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215258814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:00.511272 run patchelf(pid=18037): Terminating (SIGINT) 21:53:00.679779 run patchelf(pid=18037): Terminated: ok {rc=0} 21:53:00.800748 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18034): Process ended prematurely: osmo-stp_10.42.42.5(pid=18034) [trial-2350↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18034)] [trial-2350↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 21:53:00.809566 tst ping.py:22: Test FAILED (6.4 sec) 21:53:00.836558 run osmo-hlr_10.42.42.2(pid=18031): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18031)] 21:53:00.885650 run osmo-hlr_10.42.42.2(pid=18031): stdout: | (launched: 2022-12-08_21:52:57.705245) 21:53:00.936476 run osmo-hlr_10.42.42.2(pid=18031): stderr: | 20221208215257884 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215257884 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215257884 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215257884 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215257884 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215257884 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215257897 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215257905 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215257905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215257905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:53:00.988437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18030): Terminating (SIGTERM) 21:53:01.030330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18033): Terminating (SIGTERM) 21:53:01.073534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18036): Terminating (SIGTERM) 21:53:01.116988 --- ParallelTerminationStrategy: PID 18030 died... 21:53:01.147667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18030): Terminated: ok {rc=0} 21:53:01.215210 --- ParallelTerminationStrategy: PID 18033 died... 21:53:01.239159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18033): Terminated: ok {rc=0} 21:53:01.302043 --- ParallelTerminationStrategy: PID 18036 died... 21:53:01.325845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18036): Terminated: ok {rc=0} 21:53:01.445313 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 21:53:02.561283 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:02.578017 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:53:02.652798 tst ping_idle_ping.py: using LAC 16988 21:53:02.799756 tst ping_idle_ping.py: using RAC 158 21:53:02.966508 tst ping_idle_ping.py: using CellId 16988 21:53:03.091734 tst ping_idle_ping.py: using BVCI 16989 21:53:03.235703 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:03.247949 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:03.263082 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:03.275211 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:03.291838 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:03.302850 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:03.315732 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:03.332936 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:53:03.472803 tst ping_idle_ping.py:24: start network... 21:53:03.728139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:53:04.264605 run create_hlr_db(pid=18308): Launched 21:53:04.422845 bus /gobi_6: Setting Powered False 21:53:05.489077 run create_hlr_db(pid=18308): Terminated: ok {rc=0} 21:53:05.943748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18311): Launched 21:53:06.269692 run osmo-hlr_10.42.42.2(pid=18313): Launched 21:53:06.526698 run osmo-stp_10.42.42.5: Starting osmo-stp 21:53:07.195725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18315): Launched 21:53:07.544464 run osmo-stp_10.42.42.5(pid=18316): Launched 21:53:07.794234 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:53:08.443238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18318): Launched 21:53:08.580364 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:53:08.867513 run patchelf(pid=18319): Launched 21:53:09.062462 run osmo-stp_10.42.42.5(pid=18316): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18316)] 21:53:09.204654 run osmo-stp_10.42.42.5(pid=18316): stdout: | (launched: 2022-12-08_21:53:07.479371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:09.349635 run osmo-stp_10.42.42.5(pid=18316): stderr: | 20221208215307778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215307778 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215307779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215307779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215307780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215307780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215307780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:09.494380 run osmo-stp_10.42.42.5(pid=18316): stdout: | (launched: 2022-12-08_21:53:07.479371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:09.632237 run osmo-stp_10.42.42.5(pid=18316): stderr: | 20221208215307778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215307778 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215307779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215307779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215307780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215307780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215307780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:09.797421 run patchelf(pid=18319): Terminating (SIGINT) 21:53:09.984418 run patchelf(pid=18319): Terminated: ok {rc=0} 21:53:10.120477 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18316): Process ended prematurely: osmo-stp_10.42.42.5(pid=18316) [trial-2350↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18316)] [trial-2350↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 21:53:10.131316 tst ping_idle_ping.py:27: Test FAILED (7.6 sec) 21:53:10.163287 run osmo-hlr_10.42.42.2(pid=18313): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18313)] 21:53:10.217920 run osmo-hlr_10.42.42.2(pid=18313): stdout: | (launched: 2022-12-08_21:53:06.205456) 21:53:10.274790 run osmo-hlr_10.42.42.2(pid=18313): stderr: | 20221208215306512 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215306512 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215306512 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215306512 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215306512 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215306512 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215306535 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215306551 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215306551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215306552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:53:10.331332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18311): Terminating (SIGTERM) 21:53:10.377669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18315): Terminating (SIGTERM) 21:53:10.423770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18318): Terminating (SIGTERM) 21:53:10.471797 --- ParallelTerminationStrategy: PID 18311 died... 21:53:10.493121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18311): Terminated: ok {rc=0} 21:53:10.545470 --- ParallelTerminationStrategy: PID 18315 died... 21:53:10.566713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18315): Terminated: ok {rc=0} 21:53:10.617979 --- ParallelTerminationStrategy: PID 18318 died... 21:53:10.639003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18318): Terminated: ok {rc=0} 21:53:10.734463 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 21:53:12.032688 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:53:12.040013 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 21:53:12.065917 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 21:53:12.108400 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 21:53:12.198261 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 21:53:12.220200 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 21:53:12.263864 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 21:53:12.855385 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 21:53:12.912497 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:12.924712 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:53:12.985423 tst cs_paging_gprs_active.py: using LAC 16989 21:53:13.117267 tst cs_paging_gprs_active.py: using RAC 159 21:53:13.249418 tst cs_paging_gprs_active.py: using CellId 16989 21:53:13.380076 tst cs_paging_gprs_active.py: using BVCI 16990 21:53:13.504025 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:13.516265 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:13.529881 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:13.543176 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:13.556615 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:13.569005 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:13.583564 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:13.596599 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:13.608857 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:53:13.737261 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:53:13.862328 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:53:14.089515 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:53:14.432203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18323): Launched 21:53:14.742183 run iperf3-srv_10.42.42.10(pid=18324): Launched 21:53:14.881747 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:53:15.108429 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:53:15.453859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18325): Launched 21:53:15.763145 run iperf3-srv_10.42.42.10(pid=18326): Launched 21:53:15.915948 tst cs_paging_gprs_active.py:38: start network... 21:53:16.166610 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:53:16.805734 run create_hlr_db(pid=18327): Launched 21:53:17.000732 bus /gobi_6: Setting Powered False 21:53:18.066781 run create_hlr_db(pid=18327): Terminated: ok {rc=0} 21:53:18.581617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18329): Launched 21:53:18.935024 run osmo-hlr_10.42.42.2(pid=18330): Launched 21:53:19.190873 run osmo-stp_10.42.42.5: Starting osmo-stp 21:53:19.883593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18332): Launched 21:53:20.234649 run osmo-stp_10.42.42.5(pid=18333): Launched 21:53:20.491435 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:53:21.152829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18335): Launched 21:53:21.293706 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:53:21.584838 run patchelf(pid=18336): Launched 21:53:21.787259 run osmo-stp_10.42.42.5(pid=18333): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18333)] 21:53:21.932644 run osmo-stp_10.42.42.5(pid=18333): stdout: | (launched: 2022-12-08_21:53:20.169512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:22.079044 run osmo-stp_10.42.42.5(pid=18333): stderr: | 20221208215320472 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215320472 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215320473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215320473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215320473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215320473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215320474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:22.225335 run osmo-stp_10.42.42.5(pid=18333): stdout: | (launched: 2022-12-08_21:53:20.169512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:22.367125 run osmo-stp_10.42.42.5(pid=18333): stderr: | 20221208215320472 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215320472 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215320473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215320473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215320473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215320473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215320474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:22.534974 run patchelf(pid=18336): Terminating (SIGINT) 21:53:22.727212 run patchelf(pid=18336): Terminated: ok {rc=0} 21:53:22.866295 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18333): Process ended prematurely: osmo-stp_10.42.42.5(pid=18333) [trial-2350↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18333)] [trial-2350↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 21:53:22.877640 tst cs_paging_gprs_active.py:38: Test FAILED (10.0 sec) 21:53:22.910624 run osmo-hlr_10.42.42.2(pid=18330): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18330)] 21:53:22.965186 run osmo-hlr_10.42.42.2(pid=18330): stdout: | (launched: 2022-12-08_21:53:18.870400) 21:53:23.021324 run osmo-hlr_10.42.42.2(pid=18330): stderr: | 20221208215319186 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215319186 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215319186 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215319186 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215319186 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215319186 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215319199 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215319216 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215319216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215319216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:53:23.079262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18323): Terminating (SIGTERM) 21:53:23.125593 run iperf3-srv_10.42.42.10(pid=18324): Terminating (SIGTERM) 21:53:23.173660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18325): Terminating (SIGTERM) 21:53:23.220587 run iperf3-srv_10.42.42.10(pid=18326): Terminating (SIGTERM) 21:53:23.270051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18329): Terminating (SIGTERM) 21:53:23.316586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18332): Terminating (SIGTERM) 21:53:23.364432 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18335): Terminating (SIGTERM) 21:53:23.413289 --- ParallelTerminationStrategy: PID 18323 died... 21:53:23.434477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18323): Terminated: ok {rc=0} 21:53:23.488454 --- ParallelTerminationStrategy: PID 18324 died... 21:53:23.509765 run iperf3-srv_10.42.42.10(pid=18324): Terminated {rc=256} 21:53:23.561511 --- ParallelTerminationStrategy: PID 18325 died... 21:53:23.583219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18325): Terminated: ok {rc=0} 21:53:23.634359 --- ParallelTerminationStrategy: PID 18326 died... 21:53:23.656634 run iperf3-srv_10.42.42.10(pid=18326): Terminated {rc=256} 21:53:23.708367 --- ParallelTerminationStrategy: PID 18329 died... 21:53:23.729644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18329): Terminated: ok {rc=0} 21:53:23.781170 --- ParallelTerminationStrategy: PID 18332 died... 21:53:23.802220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18332): Terminated: ok {rc=0} 21:53:23.854520 --- ParallelTerminationStrategy: PID 18335 died... 21:53:23.875963 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18335): Terminated: ok {rc=0} 21:53:23.971550 bus /gobi_0: Setting Powered False 21:53:25.074462 bus /gobi_0: Setting Powered False 21:53:26.190766 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 21:53:27.333640 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:27.344770 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:53:27.402551 tst iperf3.py: using LAC 16990 21:53:27.522567 tst iperf3.py: using RAC 160 21:53:27.642200 tst iperf3.py: using CellId 16990 21:53:27.760720 tst iperf3.py: using BVCI 16991 21:53:27.871930 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:27.882801 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:27.893329 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:27.903792 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:27.914331 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:27.924738 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:27.935317 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:27.945747 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:27.956359 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:53:28.070077 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:53:28.276131 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:53:28.583977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18337): Launched 21:53:28.850778 run iperf3-srv_10.42.42.10(pid=18338): Launched 21:53:28.965370 tst iperf3.py:8: start network... 21:53:29.169611 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:53:29.644189 run create_hlr_db(pid=18339): Launched 21:53:29.770585 bus /gobi_6: Setting Powered False 21:53:30.844609 run create_hlr_db(pid=18339): Terminated: ok {rc=0} 21:53:31.299533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18341): Launched 21:53:31.634491 run osmo-hlr_10.42.42.2(pid=18342): Launched 21:53:31.913269 run osmo-stp_10.42.42.5: Starting osmo-stp 21:53:32.507342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18344): Launched 21:53:32.844102 run osmo-stp_10.42.42.5(pid=18345): Launched 21:53:32.969482 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:53:33.534746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18347): Launched 21:53:33.660515 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:53:33.938701 run patchelf(pid=18348): Launched 21:53:34.121735 run osmo-stp_10.42.42.5(pid=18345): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18345)] 21:53:34.261761 run osmo-stp_10.42.42.5(pid=18345): stdout: | (launched: 2022-12-08_21:53:32.784364) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:34.402728 run osmo-stp_10.42.42.5(pid=18345): stderr: | 20221208215332980 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215332980 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215332981 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215332981 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215332982 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215332982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215332982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:34.543755 run osmo-stp_10.42.42.5(pid=18345): stdout: | (launched: 2022-12-08_21:53:32.784364) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:34.679088 run osmo-stp_10.42.42.5(pid=18345): stderr: | 20221208215332980 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215332980 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215332981 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215332981 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215332982 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215332982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215332982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:34.839574 run patchelf(pid=18348): Terminating (SIGINT) 21:53:35.024180 run patchelf(pid=18348): Terminated: ok {rc=0} 21:53:35.156831 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18345): Process ended prematurely: osmo-stp_10.42.42.5(pid=18345) [trial-2350↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18345)] [trial-2350↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 21:53:35.167158 tst iperf3.py:8: Test FAILED (7.9 sec) 21:53:35.196868 run osmo-hlr_10.42.42.2(pid=18342): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18342)] 21:53:35.248371 run osmo-hlr_10.42.42.2(pid=18342): stdout: | (launched: 2022-12-08_21:53:31.566823) 21:53:35.301497 run osmo-hlr_10.42.42.2(pid=18342): stderr: | 20221208215331807 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215331807 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215331807 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215331807 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215331807 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215331807 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215331822 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215331835 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215331836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215331836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:53:35.355184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18337): Terminating (SIGTERM) 21:53:35.398172 run iperf3-srv_10.42.42.10(pid=18338): Terminating (SIGTERM) 21:53:35.441050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18341): Terminating (SIGTERM) 21:53:35.483931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18344): Terminating (SIGTERM) 21:53:35.526658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18347): Terminating (SIGTERM) 21:53:35.569607 --- ParallelTerminationStrategy: PID 18337 died... 21:53:35.589845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18337): Terminated: ok {rc=0} 21:53:35.637932 --- ParallelTerminationStrategy: PID 18338 died... 21:53:35.657789 run iperf3-srv_10.42.42.10(pid=18338): Terminated {rc=256} 21:53:35.705189 --- ParallelTerminationStrategy: PID 18341 died... 21:53:35.725103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18341): Terminated: ok {rc=0} 21:53:35.773259 --- ParallelTerminationStrategy: PID 18344 died... 21:53:35.793153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18344): Terminated: ok {rc=0} 21:53:35.841991 --- ParallelTerminationStrategy: PID 18347 died... 21:53:35.861151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18347): Terminated: ok {rc=0} 21:53:35.948370 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 21:53:37.103377 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:37.115541 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:53:37.180510 tst iperf3m4.py: using LAC 16991 21:53:37.311027 tst iperf3m4.py: using RAC 161 21:53:37.440390 tst iperf3m4.py: using CellId 16991 21:53:37.568814 tst iperf3m4.py: using BVCI 16992 21:53:37.689143 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:37.700393 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:37.712010 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:37.723965 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:37.735753 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:37.747639 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:37.759341 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:37.770962 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:37.782978 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:53:37.902603 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:53:38.024674 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:53:38.141603 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:53:38.260316 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:53:38.482129 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:53:38.809945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18351): Launched 21:53:39.094131 run iperf3-srv_10.42.42.10(pid=18352): Launched 21:53:39.217099 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:53:39.437394 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:53:39.765555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18353): Launched 21:53:40.050777 run iperf3-srv_10.42.42.10(pid=18354): Launched 21:53:40.165213 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:53:40.369409 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:53:40.674885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18355): Launched 21:53:40.940724 run iperf3-srv_10.42.42.10(pid=18356): Launched 21:53:41.054681 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:53:41.257620 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:53:41.562601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18357): Launched 21:53:41.827481 run iperf3-srv_10.42.42.10(pid=18358): Launched 21:53:41.941610 tst iperf3m4.py:8: start network... 21:53:42.144073 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:53:42.616035 run create_hlr_db(pid=18359): Launched 21:53:42.741926 bus /gobi_6: Setting Powered False 21:53:43.804004 run create_hlr_db(pid=18359): Terminated: ok {rc=0} 21:53:44.228829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18361): Launched 21:53:44.534210 run osmo-hlr_10.42.42.2(pid=18362): Launched 21:53:44.649088 run osmo-stp_10.42.42.5: Starting osmo-stp 21:53:45.178265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18364): Launched 21:53:45.482249 run osmo-stp_10.42.42.5(pid=18365): Launched 21:53:45.596858 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:53:46.137864 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18367): Launched 21:53:46.259718 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:53:46.528426 run patchelf(pid=18368): Launched 21:53:46.773058 run osmo-stp_10.42.42.5(pid=18365): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18365)] 21:53:46.919953 run osmo-stp_10.42.42.5(pid=18365): stdout: | (launched: 2022-12-08_21:53:45.426229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:47.056712 run osmo-stp_10.42.42.5(pid=18365): stderr: | 20221208215345597 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215345597 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215345597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215345598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215345600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215345600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215345600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:47.192870 run osmo-stp_10.42.42.5(pid=18365): stdout: | (launched: 2022-12-08_21:53:45.426229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:47.321409 run osmo-stp_10.42.42.5(pid=18365): stderr: | 20221208215345597 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215345597 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215345597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215345598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215345600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215345600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215345600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:47.471280 run patchelf(pid=18368): Terminating (SIGINT) 21:53:47.642784 run patchelf(pid=18368): Terminated: ok {rc=0} 21:53:47.766674 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18365): Process ended prematurely: osmo-stp_10.42.42.5(pid=18365) [trial-2350↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18365)] [trial-2350↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 21:53:47.776316 tst iperf3m4.py:8: Test FAILED (10.7 sec) 21:53:47.804085 run osmo-hlr_10.42.42.2(pid=18362): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18362)] 21:53:47.852870 run osmo-hlr_10.42.42.2(pid=18362): stdout: | (launched: 2022-12-08_21:53:44.477925) 21:53:47.903339 run osmo-hlr_10.42.42.2(pid=18362): stderr: | 20221208215344657 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215344657 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215344657 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215344657 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215344657 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215344657 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215344669 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215344678 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215344678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215344678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:53:47.954111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18351): Terminating (SIGTERM) 21:53:47.994605 run iperf3-srv_10.42.42.10(pid=18352): Terminating (SIGTERM) 21:53:48.035293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18353): Terminating (SIGTERM) 21:53:48.076390 run iperf3-srv_10.42.42.10(pid=18354): Terminating (SIGTERM) 21:53:48.117238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18355): Terminating (SIGTERM) 21:53:48.157977 run iperf3-srv_10.42.42.10(pid=18356): Terminating (SIGTERM) 21:53:48.198592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18357): Terminating (SIGTERM) 21:53:48.239397 run iperf3-srv_10.42.42.10(pid=18358): Terminating (SIGTERM) 21:53:48.279958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18361): Terminating (SIGTERM) 21:53:48.320744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18364): Terminating (SIGTERM) 21:53:48.361736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18367): Terminating (SIGTERM) 21:53:48.403469 --- ParallelTerminationStrategy: PID 18351 died... 21:53:48.422896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18351): Terminated: ok {rc=0} 21:53:48.468369 --- ParallelTerminationStrategy: PID 18352 died... 21:53:48.487553 run iperf3-srv_10.42.42.10(pid=18352): Terminated {rc=256} 21:53:48.532833 --- ParallelTerminationStrategy: PID 18353 died... 21:53:48.552360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18353): Terminated: ok {rc=0} 21:53:48.597512 --- ParallelTerminationStrategy: PID 18354 died... 21:53:48.616453 run iperf3-srv_10.42.42.10(pid=18354): Terminated {rc=256} 21:53:48.661671 --- ParallelTerminationStrategy: PID 18355 died... 21:53:48.680829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18355): Terminated: ok {rc=0} 21:53:48.726135 --- ParallelTerminationStrategy: PID 18356 died... 21:53:48.745296 run iperf3-srv_10.42.42.10(pid=18356): Terminated {rc=256} 21:53:48.790682 --- ParallelTerminationStrategy: PID 18357 died... 21:53:48.809924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18357): Terminated: ok {rc=0} 21:53:48.855175 --- ParallelTerminationStrategy: PID 18358 died... 21:53:48.874462 run iperf3-srv_10.42.42.10(pid=18358): Terminated {rc=256} 21:53:48.919581 --- ParallelTerminationStrategy: PID 18361 died... 21:53:48.938870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18361): Terminated: ok {rc=0} 21:53:48.984475 --- ParallelTerminationStrategy: PID 18364 died... 21:53:49.003770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18364): Terminated: ok {rc=0} 21:53:49.048939 --- ParallelTerminationStrategy: PID 18367 died... 21:53:49.068096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18367): Terminated: ok {rc=0} 21:53:49.153978 bus /gobi_4: Setting Powered False 21:53:50.254634 bus /gobi_4: Setting Powered False 21:53:51.373643 bus /gobi_1: Setting Powered False 21:53:52.471137 bus /gobi_1: Setting Powered False 21:53:53.585776 bus /gobi_0: Setting Powered False 21:53:54.682262 bus /gobi_0: Setting Powered False 21:53:55.796671 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 21:53:56.900210 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:56.912317 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:53:56.975120 tst ping.py: using LAC 16992 21:53:57.100819 tst ping.py: using RAC 162 21:53:57.225998 tst ping.py: using CellId 16992 21:53:57.352875 tst ping.py: using BVCI 16993 21:53:57.471466 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:57.482984 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:57.494144 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:57.505441 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:57.516675 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:57.527691 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:57.539073 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:57.550130 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:53:57.666659 tst ping.py:19: start network... 21:53:57.866806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:53:58.330902 run create_hlr_db(pid=18370): Launched 21:53:58.453819 bus /gobi_6: Setting Powered False 21:53:59.514606 run create_hlr_db(pid=18370): Terminated: ok {rc=0} 21:53:59.954414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18372): Launched 21:54:00.276290 run osmo-hlr_10.42.42.2(pid=18373): Launched 21:54:00.399058 run osmo-stp_10.42.42.5: Starting osmo-stp 21:54:00.970927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18375): Launched 21:54:01.299052 run osmo-stp_10.42.42.5(pid=18376): Launched 21:54:01.473688 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:54:02.103319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18378): Launched 21:54:02.238125 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:54:02.511055 run patchelf(pid=18379): Launched 21:54:02.690856 run osmo-stp_10.42.42.5(pid=18376): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18376)] 21:54:02.828120 run osmo-stp_10.42.42.5(pid=18376): stdout: | (launched: 2022-12-08_21:54:01.234740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:02.966775 run osmo-stp_10.42.42.5(pid=18376): stderr: | 20221208215401602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215401602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215401603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215401603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215401603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215401603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215401603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:03.105545 run osmo-stp_10.42.42.5(pid=18376): stdout: | (launched: 2022-12-08_21:54:01.234740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:03.239308 run osmo-stp_10.42.42.5(pid=18376): stderr: | 20221208215401602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215401602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215401603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215401603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215401603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215401603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215401603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:03.396352 run patchelf(pid=18379): Terminating (SIGINT) 21:54:03.577545 run patchelf(pid=18379): Terminated: ok {rc=0} 21:54:03.707610 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18376): Process ended prematurely: osmo-stp_10.42.42.5(pid=18376) [trial-2350↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18376)] [trial-2350↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 21:54:03.717257 tst ping.py:22: Test FAILED (6.8 sec) 21:54:03.746226 run osmo-hlr_10.42.42.2(pid=18373): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18373)] 21:54:03.798514 run osmo-hlr_10.42.42.2(pid=18373): stdout: | (launched: 2022-12-08_21:54:00.217682) 21:54:03.852309 run osmo-hlr_10.42.42.2(pid=18373): stderr: | 20221208215400416 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215400416 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215400416 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215400416 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215400417 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215400417 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215400428 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215400438 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215400438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215400438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:54:03.906490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18372): Terminating (SIGTERM) 21:54:03.950143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18375): Terminating (SIGTERM) 21:54:03.993793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18378): Terminating (SIGTERM) 21:54:04.037628 --- ParallelTerminationStrategy: PID 18372 died... 21:54:04.058163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18372): Terminated: ok {rc=0} 21:54:04.106731 --- ParallelTerminationStrategy: PID 18375 died... 21:54:04.126877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18375): Terminated: ok {rc=0} 21:54:04.175252 --- ParallelTerminationStrategy: PID 18378 died... 21:54:04.195364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18378): Terminated: ok {rc=0} 21:54:04.286775 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 21:54:05.374919 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:05.387107 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:54:05.447659 tst ping_idle_ping.py: using LAC 16993 21:54:05.575761 tst ping_idle_ping.py: using RAC 163 21:54:05.702062 tst ping_idle_ping.py: using CellId 16993 21:54:05.830626 tst ping_idle_ping.py: using BVCI 16994 21:54:05.948055 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:05.959412 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:05.970436 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:05.981682 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:05.993008 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:06.004231 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:06.015723 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:06.027042 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:54:06.145061 tst ping_idle_ping.py:24: start network... 21:54:06.347445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:54:06.816874 run create_hlr_db(pid=18380): Launched 21:54:06.940900 bus /gobi_6: Setting Powered False 21:54:08.001575 run create_hlr_db(pid=18380): Terminated: ok {rc=0} 21:54:08.442523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18383): Launched 21:54:08.764933 run osmo-hlr_10.42.42.2(pid=18384): Launched 21:54:08.887874 run osmo-stp_10.42.42.5: Starting osmo-stp 21:54:09.449709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18386): Launched 21:54:09.771808 run osmo-stp_10.42.42.5(pid=18387): Launched 21:54:09.893905 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:54:10.450594 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18389): Launched 21:54:10.574083 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:54:10.847919 run patchelf(pid=18390): Launched 21:54:11.027915 run osmo-stp_10.42.42.5(pid=18387): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18387)] 21:54:11.166452 run osmo-stp_10.42.42.5(pid=18387): stdout: | (launched: 2022-12-08_21:54:09.713062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:11.306571 run osmo-stp_10.42.42.5(pid=18387): stderr: | 20221208215409905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215409905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215409905 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215409906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215409908 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215409908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215409908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:11.445835 run osmo-stp_10.42.42.5(pid=18387): stdout: | (launched: 2022-12-08_21:54:09.713062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:11.579260 run osmo-stp_10.42.42.5(pid=18387): stderr: | 20221208215409905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215409905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215409905 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215409906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215409908 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215409908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215409908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:11.736675 run patchelf(pid=18390): Terminating (SIGINT) 21:54:11.918678 run patchelf(pid=18390): Terminated: ok {rc=0} 21:54:12.049300 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18387): Process ended prematurely: osmo-stp_10.42.42.5(pid=18387) [trial-2350↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18387)] [trial-2350↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 21:54:12.058966 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 21:54:12.087997 run osmo-hlr_10.42.42.2(pid=18384): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18384)] 21:54:12.139638 run osmo-hlr_10.42.42.2(pid=18384): stdout: | (launched: 2022-12-08_21:54:08.706178) 21:54:12.193252 run osmo-hlr_10.42.42.2(pid=18384): stderr: | 20221208215408906 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215408906 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215408906 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215408906 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215408906 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215408906 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215408919 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215408927 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215408927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215408927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:54:12.247462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18383): Terminating (SIGTERM) 21:54:12.290743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18386): Terminating (SIGTERM) 21:54:12.333775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18389): Terminating (SIGTERM) 21:54:12.377065 --- ParallelTerminationStrategy: PID 18383 died... 21:54:12.397500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18383): Terminated: ok {rc=0} 21:54:12.445837 --- ParallelTerminationStrategy: PID 18386 died... 21:54:12.465880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18386): Terminated: ok {rc=0} 21:54:12.513679 --- ParallelTerminationStrategy: PID 18389 died... 21:54:12.533868 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18389): Terminated: ok {rc=0} 21:54:12.623194 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 21:54:13.913515 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:54:13.919839 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:54:13.940006 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 21:54:13.974503 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:54:14.025252 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:54:14.045583 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 21:54:14.079231 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:54:14.637391 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2350 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 21:54:14.642350 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:54:14.653412 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:54:14.707765 tst switch_tch_pdch.py: using LAC 16994 21:54:14.824572 tst switch_tch_pdch.py: using RAC 164 21:54:14.941117 tst switch_tch_pdch.py: using CellId 16994 21:54:15.061849 tst switch_tch_pdch.py: using BVCI 16995 21:54:15.171207 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:54:15.182784 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:54:15.193900 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:54:15.204883 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:54:15.215767 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:54:15.226796 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:54:15.237906 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:54:15.248807 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:54:15.368838 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:54:15.486929 tst switch_tch_pdch.py:51: start network... 21:54:15.702632 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:54:16.216457 run create_hlr_db(pid=18394): Launched 21:54:16.373710 bus /gobi_6: Setting Powered False 21:54:17.434336 run create_hlr_db(pid=18394): Terminated: ok {rc=0} 21:54:17.878697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18396): Launched 21:54:18.200709 run osmo-hlr_10.42.42.2(pid=18397): Launched 21:54:18.323482 run osmo-stp_10.42.42.5: Starting osmo-stp 21:54:18.881304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18399): Launched 21:54:19.202783 run osmo-stp_10.42.42.5(pid=18400): Launched 21:54:19.325686 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:54:19.880604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18402): Launched 21:54:20.003249 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:54:20.274937 run patchelf(pid=18403): Launched 21:54:20.453451 run osmo-stp_10.42.42.5(pid=18400): ERR: Terminated: ERROR {rc=1} [trial-2350↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18400)] 21:54:20.590665 run osmo-stp_10.42.42.5(pid=18400): stdout: | (launched: 2022-12-08_21:54:19.144150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:20.729038 run osmo-stp_10.42.42.5(pid=18400): stderr: | 20221208215419336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215419336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215419336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215419337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215419337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215419337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215419338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:20.867483 run osmo-stp_10.42.42.5(pid=18400): stdout: | (launched: 2022-12-08_21:54:19.144150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:21.000026 run osmo-stp_10.42.42.5(pid=18400): stderr: | 20221208215419336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215419336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215419336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215419337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215419337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215419337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215419338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:21.156422 run patchelf(pid=18403): Terminating (SIGINT) 21:54:21.338549 run patchelf(pid=18403): Terminated: ok {rc=0} 21:54:21.469105 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=18400): Process ended prematurely: osmo-stp_10.42.42.5(pid=18400) [trial-2350↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18400)] [trial-2350↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 21:54:21.478723 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 21:54:21.507927 run osmo-hlr_10.42.42.2(pid=18397): ERR: Terminated: ERROR {rc=237} [trial-2350↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18397)] 21:54:21.559481 run osmo-hlr_10.42.42.2(pid=18397): stdout: | (launched: 2022-12-08_21:54:18.141966) 21:54:21.613117 run osmo-hlr_10.42.42.2(pid=18397): stderr: | 20221208215418341 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215418341 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215418342 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215418342 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215418342 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215418342 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215418354 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215418362 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215418362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215418362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:54:21.666904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18396): Terminating (SIGTERM) 21:54:21.710053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18399): Terminating (SIGTERM) 21:54:21.753241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18402): Terminating (SIGTERM) 21:54:21.796573 --- ParallelTerminationStrategy: PID 18396 died... 21:54:21.817261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18396): Terminated: ok {rc=0} 21:54:21.865567 --- ParallelTerminationStrategy: PID 18399 died... 21:54:21.885612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18399): Terminated: ok {rc=0} 21:54:21.933764 --- ParallelTerminationStrategy: PID 18402 died... 21:54:21.953771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18402): Terminated: ok {rc=0} 21:54:22.042472 bus /gobi_0: Setting Powered False 21:54:23.142702 bus /gobi_0: Setting Powered False 21:54:24.260861 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 21:54:25.498381 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:54:25.504808 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 21:54:25.526210 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 21:54:25.561873 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 21:54:25.615261 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 21:54:25.636296 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 21:54:25.671532 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 21:54:26.227532 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2350 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 21:54:26.232719 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:54:26.243938 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 21:54:26.301898 tst switch_tch_pdch.py: using LAC 16995 21:54:26.429495 tst switch_tch_pdch.py: using RAC 165 21:54:26.556326 tst switch_tch_pdch.py: using CellId 16995 21:54:26.676898 tst switch_tch_pdch.py: using BVCI 16996 21:54:26.788004 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:54:26.798981 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:54:26.810080 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:54:26.821505 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:54:26.832784 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:54:26.844030 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:54:26.855477 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:54:26.866893 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 21:54:26.986907 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 21:54:27.102428 tst switch_tch_pdch.py:51: start network... 21:54:27.303548 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:54:27.741849 run create_hlr_db(pid=18407): Launched 21:54:27.865482 bus /gobi_6: Setting Powered False 21:54:28.926356 run create_hlr_db(pid=18407): Terminated: ok {rc=0} 21:54:29.340049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18409): Launched 21:54:29.661776 run osmo-hlr_10.42.42.2(pid=18410): Launched 21:54:29.784899 run osmo-stp_10.42.42.5: Starting osmo-stp 21:54:30.280660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18412): Launched 21:54:30.580400 run osmo-stp_10.42.42.5(pid=18413): Launched 21:54:30.694673 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:54:31.238620 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18415): Launched 21:54:31.375400 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:54:31.669680 run patchelf(pid=18416): Launched 21:54:31.856563 run osmo-stp_10.42.42.5(pid=18413): ERR: Terminated: ERROR {rc=1} [trial-2350↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18413)] 21:54:31.997345 run osmo-stp_10.42.42.5(pid=18413): stdout: | (launched: 2022-12-08_21:54:30.525321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:32.140699 run osmo-stp_10.42.42.5(pid=18413): stderr: | 20221208215430697 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215430697 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215430697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215430698 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215430698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215430698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215430698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:32.280112 run osmo-stp_10.42.42.5(pid=18413): stdout: | (launched: 2022-12-08_21:54:30.525321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:32.413469 run osmo-stp_10.42.42.5(pid=18413): stderr: | 20221208215430697 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215430697 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215430697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215430698 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215430698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215430698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215430698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:32.571440 run patchelf(pid=18416): Terminating (SIGINT) 21:54:32.752366 run patchelf(pid=18416): Terminated: ok {rc=0} 21:54:32.882714 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=18413): Process ended prematurely: osmo-stp_10.42.42.5(pid=18413) [trial-2350↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18413)] [trial-2350↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 21:54:32.892430 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 21:54:32.921812 run osmo-hlr_10.42.42.2(pid=18410): ERR: Terminated: ERROR {rc=237} [trial-2350↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18410)] 21:54:32.973516 run osmo-hlr_10.42.42.2(pid=18410): stdout: | (launched: 2022-12-08_21:54:29.603297) 21:54:33.026872 run osmo-hlr_10.42.42.2(pid=18410): stderr: | 20221208215429802 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215429802 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215429802 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215429802 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215429802 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215429803 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215429818 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215429828 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215429829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215429829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:54:33.080776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18409): Terminating (SIGTERM) 21:54:33.124114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18412): Terminating (SIGTERM) 21:54:33.167494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18415): Terminating (SIGTERM) 21:54:33.211223 --- ParallelTerminationStrategy: PID 18409 died... 21:54:33.232101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18409): Terminated: ok {rc=0} 21:54:33.280685 --- ParallelTerminationStrategy: PID 18412 died... 21:54:33.301036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18412): Terminated: ok {rc=0} 21:54:33.349593 --- ParallelTerminationStrategy: PID 18415 died... 21:54:33.369673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18415): Terminated: ok {rc=0} 21:54:33.459148 bus /gobi_0: Setting Powered False 21:54:34.559927 bus /gobi_0: Setting Powered False 21:54:35.679191 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 nitb_sms:oc2g --------------------------------------------------------------------- 21:54:36.917975 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:54:36.922313 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 21:54:36.943057 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 21:54:36.949646 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 21:54:37.001983 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 21:54:37.022387 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 21:54:37.028899 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 21:54:37.563471 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 21:54:37.568237 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 21:54:37.578810 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 21:54:37.613282 tst mo_mt_sms.py: using LAC 16996 21:54:37.733413 tst mo_mt_sms.py: using RAC 166 21:54:37.852490 tst mo_mt_sms.py: using CellId 16996 21:54:37.970745 tst mo_mt_sms.py: using BVCI 16997 21:54:38.081334 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 21:54:38.198763 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 21:54:38.314335 tst mo_mt_sms.py:9: start nitb and bts... 21:54:38.516832 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:54:39.129548 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18420): Launched 21:54:39.433400 run osmo-nitb_10.42.42.2(pid=18421): Launched 21:54:39.600691 run osmo-nitb_10.42.42.2(pid=18421): ERR: Terminated: ERROR {rc=2} [trial-2350↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18421)] 21:54:39.736573 run osmo-nitb_10.42.42.2(pid=18421): stdout: | (launched: 2022-12-08_21:54:39.377548) 21:54:39.873733 run osmo-nitb_10.42.42.2(pid=18421): stderr: | (launched: 2022-12-08_21:54:39.422884) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:54:40.018310 run osmo-nitb_10.42.42.2(pid=18421): stdout: | (launched: 2022-12-08_21:54:39.377548) 21:54:40.154640 run osmo-nitb_10.42.42.2(pid=18421): stderr: | (launched: 2022-12-08_21:54:39.422884) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3c9519268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=18421): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18421) [trial-2350↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18421)] 21:54:40.547529 tst osmo-nitb_10.42.42.2(pid=18421): stdout: | (launched: 2022-12-08_21:54:39.377548) 21:54:40.668564 tst osmo-nitb_10.42.42.2(pid=18421): stderr: | (launched: 2022-12-08_21:54:39.422884) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:54:40.810633 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=18421): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18421) [trial-2350↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18421)] [trial-2350↪nitb_sms:oc2g↪mo_mt_sms.py:11] 21:54:40.818907 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 21:54:40.825411 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18420): Terminating (SIGTERM) 21:54:41.034290 --- ParallelTerminationStrategy: PID 18420 died... 21:54:41.055352 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18420): Terminated: ok {rc=0} 21:54:41.141872 bus /sierra_3: Setting Powered False 21:54:42.243971 bus /sierra_3: Setting Powered False 21:54:43.363643 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 sms:oc2g --------------------------------------------------------------------- 21:54:44.546913 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:54:44.550856 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 21:54:44.570854 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 21:54:44.597318 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 21:54:44.648156 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 21:54:44.668291 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 21:54:44.694330 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 21:54:45.239660 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 sms:oc2g mo_mt_sms.py ---------------------------------------------- 21:54:45.244355 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 21:54:45.254804 tst sms:oc2g: Using 1 x bts (candidates: 1) 21:54:45.292887 tst mo_mt_sms.py: using LAC 16997 21:54:45.410782 tst mo_mt_sms.py: using RAC 167 21:54:45.537363 tst mo_mt_sms.py: using CellId 16997 21:54:45.663795 tst mo_mt_sms.py: using BVCI 16998 21:54:45.780941 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 21:54:45.792158 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 21:54:45.803150 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 21:54:45.814165 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 21:54:45.825410 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 21:54:45.840588 tst sms:oc2g: Using 1 x modem (candidates: 2) 21:54:45.965558 tst sms:oc2g: Using 1 x modem (candidates: 2) 21:54:46.094343 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:54:46.608094 run create_hlr_db(pid=18426): Launched 21:54:46.766104 bus /sierra_2: Setting Powered False 21:54:47.830344 run create_hlr_db(pid=18426): Terminated: ok {rc=0} 21:54:48.278825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18428): Launched 21:54:48.600583 run osmo-hlr_10.42.42.2(pid=18429): Launched 21:54:48.722476 run osmo-stp_10.42.42.5: Starting osmo-stp 21:54:49.277353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18431): Launched 21:54:49.599403 run osmo-stp_10.42.42.5(pid=18432): Launched 21:54:49.722494 run osmo-msc_10.42.42.6: Starting osmo-msc 21:54:50.304552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18434): Launched 21:54:50.627592 run osmo-msc_10.42.42.6(pid=18435): Launched 21:54:50.806680 run osmo-stp_10.42.42.5(pid=18432): ERR: Terminated: ERROR {rc=1} [trial-2350↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18432)] 21:54:50.943071 run osmo-stp_10.42.42.5(pid=18432): stdout: | (launched: 2022-12-08_21:54:49.540860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:51.080095 run osmo-stp_10.42.42.5(pid=18432): stderr: | 20221208215449735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215449735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215449735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215449735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215449736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215449736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215449736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:51.216228 run osmo-stp_10.42.42.5(pid=18432): stdout: | (launched: 2022-12-08_21:54:49.540860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:51.345566 run osmo-stp_10.42.42.5(pid=18432): stderr: | 20221208215449735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215449735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215449735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215449735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215449736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215449736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215449736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:51.499462 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=18432): Process ended prematurely: osmo-stp_10.42.42.5(pid=18432) [trial-2350↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18432)] [trial-2350↪sms:oc2g↪mo_mt_sms.py:16] 21:54:51.508453 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 21:54:51.536823 run osmo-hlr_10.42.42.2(pid=18429): ERR: Terminated: ERROR {rc=237} [trial-2350↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18429)] 21:54:51.588414 run osmo-hlr_10.42.42.2(pid=18429): stdout: | (launched: 2022-12-08_21:54:48.541938) 21:54:51.641813 run osmo-hlr_10.42.42.2(pid=18429): stderr: | 20221208215448743 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215448743 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215448743 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215448743 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215448743 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215448743 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215448754 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215448763 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215448763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215448763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:54:51.715982 run osmo-msc_10.42.42.6(pid=18435): ERR: Terminated: ERROR {rc=2} [trial-2350↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18435)] 21:54:51.767638 run osmo-msc_10.42.42.6(pid=18435): stdout: | (launched: 2022-12-08_21:54:50.568657) 21:54:51.820857 run osmo-msc_10.42.42.6(pid=18435): stderr: | 20221208215450891 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208215450891 DLGLOBAL DEBUG validating counter group 0x7fe43815ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208215450891 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208215450891 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208215450891 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208215450891 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208215450893 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208215450894 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208215450894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208215450894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:54:51.874630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18428): Terminating (SIGTERM) 21:54:51.917703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18431): Terminating (SIGTERM) 21:54:51.960763 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18434): Terminating (SIGTERM) 21:54:52.004442 --- ParallelTerminationStrategy: PID 18428 died... 21:54:52.024996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18428): Terminated: ok {rc=0} 21:54:52.072817 --- ParallelTerminationStrategy: PID 18431 died... 21:54:52.092902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18431): Terminated: ok {rc=0} 21:54:52.140863 --- ParallelTerminationStrategy: PID 18434 died... 21:54:52.160863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18434): Terminated: ok {rc=0} 21:54:52.250462 bus /sierra_3: Setting Powered False 21:54:53.349507 bus /sierra_3: Setting Powered False 21:54:54.464785 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 nitb_ussd:oc2g --------------------------------------------------------------------- 21:54:55.681512 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:54:55.685489 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 21:54:55.706520 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 21:54:55.714429 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 21:54:55.749863 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 21:54:55.770406 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 21:54:55.777503 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 21:54:56.297703 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2350 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 21:54:56.303726 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 21:54:56.314606 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 21:54:56.349150 tst assert_extension.py: using LAC 16998 21:54:56.467386 tst assert_extension.py: using RAC 168 21:54:56.585855 tst assert_extension.py: using CellId 16998 21:54:56.703856 tst assert_extension.py: using BVCI 16999 21:54:56.814180 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 21:54:56.929896 tst assert_extension.py:10: start nitb and bts... 21:54:57.146647 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:54:57.802639 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18440): Launched 21:54:58.125077 run osmo-nitb_10.42.42.2(pid=18441): Launched 21:54:58.304015 run osmo-nitb_10.42.42.2(pid=18441): ERR: Terminated: ERROR {rc=2} [trial-2350↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18441)] 21:54:58.449389 run osmo-nitb_10.42.42.2(pid=18441): stdout: | (launched: 2022-12-08_21:54:58.066175) 21:54:58.596048 run osmo-nitb_10.42.42.2(pid=18441): stderr: | (launched: 2022-12-08_21:54:58.114254) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:54:58.742704 run osmo-nitb_10.42.42.2(pid=18441): stdout: | (launched: 2022-12-08_21:54:58.066175) 21:54:58.884004 run osmo-nitb_10.42.42.2(pid=18441): stderr: | (launched: 2022-12-08_21:54:58.114254) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3c9519268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=18441): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18441) [trial-2350↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18441)] 21:54:59.246628 tst osmo-nitb_10.42.42.2(pid=18441): stdout: | (launched: 2022-12-08_21:54:58.066175) 21:54:59.377048 tst osmo-nitb_10.42.42.2(pid=18441): stderr: | (launched: 2022-12-08_21:54:58.114254) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:54:59.530854 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=18441): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18441) [trial-2350↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18441)] [trial-2350↪nitb_ussd:oc2g↪assert_extension.py:12] 21:54:59.539967 tst assert_extension.py:12: Test FAILED (3.2 sec) 21:54:59.547496 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18440): Terminating (SIGTERM) 21:54:59.760237 --- ParallelTerminationStrategy: PID 18440 died... 21:54:59.782474 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18440): Terminated: ok {rc=0} 21:54:59.872561 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 ussd:oc2g --------------------------------------------------------------------- 21:55:01.048245 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:55:01.053281 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 21:55:01.074532 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 21:55:01.102016 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 21:55:01.138047 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 21:55:01.167149 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 21:55:01.203290 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 21:55:01.723933 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2350 ussd:oc2g assert_extension.py ---------------------------------------------- 21:55:01.731178 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 21:55:01.742875 tst ussd:oc2g: Using 1 x bts (candidates: 1) 21:55:01.778201 tst assert_extension.py: using LAC 16999 21:55:01.942778 tst assert_extension.py: using RAC 169 21:55:02.086761 tst assert_extension.py: using CellId 16999 21:55:02.256607 tst assert_extension.py: using BVCI 17000 21:55:02.392657 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 21:55:02.403737 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 21:55:02.414743 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 21:55:02.426497 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 21:55:02.438360 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 21:55:02.449871 tst ussd:oc2g: Using 1 x modem (candidates: 1) 21:55:02.565160 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:55:03.029592 run create_hlr_db(pid=18448): Launched 21:55:03.152661 bus /sierra_2: Setting Powered False 21:55:04.217414 run create_hlr_db(pid=18448): Terminated: ok {rc=0} 21:55:04.666653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18450): Launched 21:55:04.988548 run osmo-hlr_10.42.42.2(pid=18451): Launched 21:55:05.111898 run osmo-stp_10.42.42.5: Starting osmo-stp 21:55:05.676362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18453): Launched 21:55:05.998244 run osmo-stp_10.42.42.5(pid=18454): Launched 21:55:06.120485 run osmo-msc_10.42.42.6: Starting osmo-msc 21:55:06.701754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18456): Launched 21:55:07.024182 run osmo-msc_10.42.42.6(pid=18457): Launched 21:55:07.202824 run osmo-stp_10.42.42.5(pid=18454): ERR: Terminated: ERROR {rc=1} [trial-2350↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18454)] 21:55:07.339950 run osmo-stp_10.42.42.5(pid=18454): stdout: | (launched: 2022-12-08_21:55:05.939634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:07.477126 run osmo-stp_10.42.42.5(pid=18454): stderr: | 20221208215506132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215506132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215506133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215506133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215506134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215506134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215506134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:07.613517 run osmo-stp_10.42.42.5(pid=18454): stdout: | (launched: 2022-12-08_21:55:05.939634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:07.742233 run osmo-stp_10.42.42.5(pid=18454): stderr: | 20221208215506132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215506132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215506133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215506133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215506134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215506134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215506134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:07.895966 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=18454): Process ended prematurely: osmo-stp_10.42.42.5(pid=18454) [trial-2350↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18454)] [trial-2350↪ussd:oc2g↪assert_extension.py:17] 21:55:07.905064 tst assert_extension.py:17: Test FAILED (6.2 sec) 21:55:07.933536 run osmo-hlr_10.42.42.2(pid=18451): ERR: Terminated: ERROR {rc=237} [trial-2350↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18451)] 21:55:07.984781 run osmo-hlr_10.42.42.2(pid=18451): stdout: | (launched: 2022-12-08_21:55:04.929713) 21:55:08.037696 run osmo-hlr_10.42.42.2(pid=18451): stderr: | 20221208215505128 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215505128 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215505128 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215505128 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215505128 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215505128 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215505140 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215505148 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215505148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215505148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:55:08.110873 run osmo-msc_10.42.42.6(pid=18457): ERR: Terminated: ERROR {rc=2} [trial-2350↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18457)] 21:55:08.161780 run osmo-msc_10.42.42.6(pid=18457): stdout: | (launched: 2022-12-08_21:55:06.965371) 21:55:08.214356 run osmo-msc_10.42.42.6(pid=18457): stderr: | 20221208215507286 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208215507286 DLGLOBAL DEBUG validating counter group 0x7f7283982c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208215507286 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208215507287 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208215507287 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208215507287 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208215507289 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208215507289 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208215507289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208215507289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:55:08.268051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18450): Terminating (SIGTERM) 21:55:08.310873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18453): Terminating (SIGTERM) 21:55:08.353685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18456): Terminating (SIGTERM) 21:55:08.396687 --- ParallelTerminationStrategy: PID 18450 died... 21:55:08.417153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18450): Terminated: ok {rc=0} 21:55:08.464635 --- ParallelTerminationStrategy: PID 18453 died... 21:55:08.484548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18453): Terminated: ok {rc=0} 21:55:08.531868 --- ParallelTerminationStrategy: PID 18456 died... 21:55:08.551839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18456): Terminated: ok {rc=0} 21:55:08.640179 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 21:55:09.834037 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:55:09.840898 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 21:55:09.862229 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 21:55:09.889355 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 21:55:09.941979 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 21:55:09.962569 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 21:55:09.989323 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 21:55:10.537333 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 21:55:10.587503 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:10.598681 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:55:10.653906 tst mo_mt_call.py: using LAC 17000 21:55:10.777317 tst mo_mt_call.py: using RAC 170 21:55:10.897622 tst mo_mt_call.py: using CellId 17000 21:55:11.016123 tst mo_mt_call.py: using BVCI 17001 21:55:11.127695 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:11.138647 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:11.149325 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:11.160569 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:11.171934 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:11.183216 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:55:11.303065 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:55:11.417370 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:55:11.895211 run create_hlr_db(pid=18462): Launched 21:55:12.020035 bus /sierra_2: Setting Powered False 21:55:13.081511 run create_hlr_db(pid=18462): Terminated: ok {rc=0} 21:55:13.530049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18464): Launched 21:55:13.859250 run osmo-hlr_10.42.42.2(pid=18465): Launched 21:55:13.984215 run osmo-stp_10.42.42.5: Starting osmo-stp 21:55:14.553074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18467): Launched 21:55:14.880935 run osmo-stp_10.42.42.5(pid=18468): Launched 21:55:15.005065 run osmo-msc_10.42.42.6: Starting osmo-msc 21:55:15.595609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18470): Launched 21:55:15.941738 run osmo-msc_10.42.42.6(pid=18471): Launched 21:55:16.452402 run osmo-stp_10.42.42.5(pid=18468): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18468)] 21:55:16.717291 run osmo-stp_10.42.42.5(pid=18468): stdout: | (launched: 2022-12-08_21:55:14.821273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:16.847934 run osmo-stp_10.42.42.5(pid=18468): stderr: | 20221208215515012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215515012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215515012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215515013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215515013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215515013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215515013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:16.978650 run osmo-stp_10.42.42.5(pid=18468): stdout: | (launched: 2022-12-08_21:55:14.821273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:17.103893 run osmo-stp_10.42.42.5(pid=18468): stderr: | 20221208215515012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215515012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215515012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215515013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215515013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215515013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215515013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:17.254615 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18468): Process ended prematurely: osmo-stp_10.42.42.5(pid=18468) [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18468)] [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 21:55:17.263690 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 21:55:17.290944 run osmo-hlr_10.42.42.2(pid=18465): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18465)] 21:55:17.340846 run osmo-hlr_10.42.42.2(pid=18465): stdout: | (launched: 2022-12-08_21:55:13.799829) 21:55:17.391664 run osmo-hlr_10.42.42.2(pid=18465): stderr: | 20221208215513999 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215513999 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215513999 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215513999 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215513999 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215513999 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215514011 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215514019 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215514019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215514019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:55:17.462407 run osmo-msc_10.42.42.6(pid=18471): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18471)] 21:55:17.511381 run osmo-msc_10.42.42.6(pid=18471): stdout: | (launched: 2022-12-08_21:55:15.864634) 21:55:17.561971 run osmo-msc_10.42.42.6(pid=18471): stderr: | 20221208215516395 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208215516395 DLGLOBAL DEBUG validating counter group 0x7f368ab54c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208215516395 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208215516396 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208215516396 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208215516397 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208215516400 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208215516401 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208215516402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208215516403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:55:17.612838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18464): Terminating (SIGTERM) 21:55:17.653203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18467): Terminating (SIGTERM) 21:55:17.694326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18470): Terminating (SIGTERM) 21:55:17.734987 --- ParallelTerminationStrategy: PID 18464 died... 21:55:17.754583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18464): Terminated: ok {rc=0} 21:55:17.800072 --- ParallelTerminationStrategy: PID 18467 died... 21:55:17.819289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18467): Terminated: ok {rc=0} 21:55:17.864609 --- ParallelTerminationStrategy: PID 18470 died... 21:55:17.883790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18470): Terminated: ok {rc=0} 21:55:17.969590 bus /sierra_3: Setting Powered False 21:55:19.069131 bus /sierra_3: Setting Powered False 21:55:20.187160 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 21:55:21.332619 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:21.344240 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:55:21.400245 tst mo_mt_call_osmux.py: using LAC 17001 21:55:21.522776 tst mo_mt_call_osmux.py: using RAC 171 21:55:21.645111 tst mo_mt_call_osmux.py: using CellId 17001 21:55:21.767468 tst mo_mt_call_osmux.py: using BVCI 17002 21:55:21.879957 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:21.890966 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:21.901815 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:21.912493 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:21.923270 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:21.934275 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:55:22.051052 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:55:22.171485 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:55:22.681718 run create_hlr_db(pid=18473): Launched 21:55:22.807717 bus /sierra_2: Setting Powered False 21:55:23.872173 run create_hlr_db(pid=18473): Terminated: ok {rc=0} 21:55:24.311002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18475): Launched 21:55:24.618048 run osmo-hlr_10.42.42.2(pid=18476): Launched 21:55:24.733622 run osmo-stp_10.42.42.5: Starting osmo-stp 21:55:25.275714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18478): Launched 21:55:25.581247 run osmo-stp_10.42.42.5(pid=18479): Launched 21:55:25.698147 run osmo-msc_10.42.42.6: Starting osmo-msc 21:55:26.251967 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18481): Launched 21:55:26.557540 run osmo-msc_10.42.42.6(pid=18482): Launched 21:55:26.728804 run osmo-stp_10.42.42.5(pid=18479): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18479)] 21:55:26.859919 run osmo-stp_10.42.42.5(pid=18479): stdout: | (launched: 2022-12-08_21:55:25.525342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:26.990011 run osmo-stp_10.42.42.5(pid=18479): stderr: | 20221208215525698 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215525698 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215525698 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215525699 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215525699 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215525699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215525699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:27.118762 run osmo-stp_10.42.42.5(pid=18479): stdout: | (launched: 2022-12-08_21:55:25.525342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:27.240850 run osmo-stp_10.42.42.5(pid=18479): stderr: | 20221208215525698 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215525698 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215525698 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215525699 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215525699 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215525699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215525699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:27.387657 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18479): Process ended prematurely: osmo-stp_10.42.42.5(pid=18479) [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18479)] [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 21:55:27.396655 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 21:55:27.423601 run osmo-hlr_10.42.42.2(pid=18476): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18476)] 21:55:27.472234 run osmo-hlr_10.42.42.2(pid=18476): stdout: | (launched: 2022-12-08_21:55:24.561588) 21:55:27.522472 run osmo-hlr_10.42.42.2(pid=18476): stderr: | 20221208215524740 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215524740 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215524740 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215524740 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215524740 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215524740 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215524753 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215524762 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215524762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215524762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:55:27.592355 run osmo-msc_10.42.42.6(pid=18482): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18482)] 21:55:27.640419 run osmo-msc_10.42.42.6(pid=18482): stdout: | (launched: 2022-12-08_21:55:26.501314) 21:55:27.690388 run osmo-msc_10.42.42.6(pid=18482): stderr: | 20221208215526774 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208215526774 DLGLOBAL DEBUG validating counter group 0x7f8fcaab6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208215526774 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208215526774 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208215526774 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208215526774 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208215526776 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208215526777 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208215526777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208215526777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:55:27.740779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18475): Terminating (SIGTERM) 21:55:27.781386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18478): Terminating (SIGTERM) 21:55:27.821421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18481): Terminating (SIGTERM) 21:55:27.861717 --- ParallelTerminationStrategy: PID 18475 died... 21:55:27.881029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18475): Terminated: ok {rc=0} 21:55:27.925764 --- ParallelTerminationStrategy: PID 18478 died... 21:55:27.944385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18478): Terminated: ok {rc=0} 21:55:27.989207 --- ParallelTerminationStrategy: PID 18481 died... 21:55:28.008038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18481): Terminated: ok {rc=0} 21:55:28.094775 bus /sierra_3: Setting Powered False 21:55:29.194527 bus /sierra_3: Setting Powered False 21:55:30.306174 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 21:55:31.545918 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:55:31.553922 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 21:55:31.579739 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 21:55:31.613444 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 21:55:31.676778 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 21:55:31.697337 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 21:55:31.725518 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 21:55:32.279481 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 21:55:32.328270 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:32.339232 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:55:32.397249 tst mo_mt_call.py: using LAC 17002 21:55:32.516435 tst mo_mt_call.py: using RAC 172 21:55:32.639664 tst mo_mt_call.py: using CellId 17002 21:55:32.768868 tst mo_mt_call.py: using BVCI 17003 21:55:32.889717 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:32.901421 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:32.912724 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:32.924530 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:32.936293 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:32.948327 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:55:33.065813 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:55:33.183830 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:55:33.693657 run create_hlr_db(pid=18487): Launched 21:55:33.818490 bus /sierra_2: Setting Powered False 21:55:34.882791 run create_hlr_db(pid=18487): Terminated: ok {rc=0} 21:55:35.340792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18489): Launched 21:55:35.669524 run osmo-hlr_10.42.42.2(pid=18490): Launched 21:55:35.795501 run osmo-stp_10.42.42.5: Starting osmo-stp 21:55:36.364464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18492): Launched 21:55:36.692574 run osmo-stp_10.42.42.5(pid=18493): Launched 21:55:36.817682 run osmo-msc_10.42.42.6: Starting osmo-msc 21:55:37.409887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18495): Launched 21:55:37.737911 run osmo-msc_10.42.42.6(pid=18496): Launched 21:55:37.920202 run osmo-stp_10.42.42.5(pid=18493): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18493)] 21:55:38.059473 run osmo-stp_10.42.42.5(pid=18493): stdout: | (launched: 2022-12-08_21:55:36.632633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:38.199077 run osmo-stp_10.42.42.5(pid=18493): stderr: | 20221208215536825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215536825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215536825 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215536825 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215536826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215536826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215536826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:38.338545 run osmo-stp_10.42.42.5(pid=18493): stdout: | (launched: 2022-12-08_21:55:36.632633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:38.470379 run osmo-stp_10.42.42.5(pid=18493): stderr: | 20221208215536825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215536825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215536825 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215536825 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215536826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215536826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215536826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:38.627371 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18493): Process ended prematurely: osmo-stp_10.42.42.5(pid=18493) [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18493)] [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 21:55:38.637112 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 21:55:38.666005 run osmo-hlr_10.42.42.2(pid=18490): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18490)] 21:55:38.717803 run osmo-hlr_10.42.42.2(pid=18490): stdout: | (launched: 2022-12-08_21:55:35.609372) 21:55:38.771258 run osmo-hlr_10.42.42.2(pid=18490): stderr: | 20221208215535808 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215535808 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215535808 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215535808 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215535808 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215535808 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215535818 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215535827 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215535827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215535827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:55:38.845738 run osmo-msc_10.42.42.6(pid=18496): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18496)] 21:55:38.897372 run osmo-msc_10.42.42.6(pid=18496): stdout: | (launched: 2022-12-08_21:55:37.678045) 21:55:38.950557 run osmo-msc_10.42.42.6(pid=18496): stderr: | 20221208215538000 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208215538000 DLGLOBAL DEBUG validating counter group 0x7f44dd7c8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208215538000 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208215538000 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208215538000 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208215538000 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208215538002 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208215538002 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208215538003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208215538003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:55:39.004213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18489): Terminating (SIGTERM) 21:55:39.047078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18492): Terminating (SIGTERM) 21:55:39.090269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18495): Terminating (SIGTERM) 21:55:39.133260 --- ParallelTerminationStrategy: PID 18489 died... 21:55:39.153675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18489): Terminated: ok {rc=0} 21:55:39.201664 --- ParallelTerminationStrategy: PID 18492 died... 21:55:39.221561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18492): Terminated: ok {rc=0} 21:55:39.269588 --- ParallelTerminationStrategy: PID 18495 died... 21:55:39.289634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18495): Terminated: ok {rc=0} 21:55:39.380274 bus /sierra_3: Setting Powered False 21:55:40.482429 bus /sierra_3: Setting Powered False 21:55:41.601053 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 21:55:42.753538 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:42.765714 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:55:42.823607 tst mo_mt_call_osmux.py: using LAC 17003 21:55:42.954270 tst mo_mt_call_osmux.py: using RAC 173 21:55:43.075564 tst mo_mt_call_osmux.py: using CellId 17003 21:55:43.197571 tst mo_mt_call_osmux.py: using BVCI 17004 21:55:43.319771 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:43.331353 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:43.342805 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:43.354612 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:43.366310 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:43.378177 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:55:43.495558 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:55:43.617580 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:55:44.127889 run create_hlr_db(pid=18498): Launched 21:55:44.253451 bus /sierra_2: Setting Powered False 21:55:45.318246 run create_hlr_db(pid=18498): Terminated: ok {rc=0} 21:55:45.756836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18500): Launched 21:55:46.081705 run osmo-hlr_10.42.42.2(pid=18501): Launched 21:55:46.207750 run osmo-stp_10.42.42.5: Starting osmo-stp 21:55:46.875617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18503): Launched 21:55:47.222581 run osmo-stp_10.42.42.5(pid=18504): Launched 21:55:47.453411 run osmo-msc_10.42.42.6: Starting osmo-msc 21:55:48.081416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18506): Launched 21:55:48.411425 run osmo-msc_10.42.42.6(pid=18507): Launched 21:55:48.595348 run osmo-stp_10.42.42.5(pid=18504): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18504)] 21:55:48.733984 run osmo-stp_10.42.42.5(pid=18504): stdout: | (launched: 2022-12-08_21:55:47.158490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:48.872686 run osmo-stp_10.42.42.5(pid=18504): stderr: | 20221208215547389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215547389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215547389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215547390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215547390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215547390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215547391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:49.010915 run osmo-stp_10.42.42.5(pid=18504): stdout: | (launched: 2022-12-08_21:55:47.158490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:49.141425 run osmo-stp_10.42.42.5(pid=18504): stderr: | 20221208215547389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215547389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215547389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215547390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215547390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215547390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215547391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:49.297638 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18504): Process ended prematurely: osmo-stp_10.42.42.5(pid=18504) [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18504)] [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 21:55:49.307370 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 21:55:49.336142 run osmo-hlr_10.42.42.2(pid=18501): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18501)] 21:55:49.387450 run osmo-hlr_10.42.42.2(pid=18501): stdout: | (launched: 2022-12-08_21:55:46.018265) 21:55:49.440570 run osmo-hlr_10.42.42.2(pid=18501): stderr: | 20221208215546371 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215546371 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215546371 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215546371 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215546371 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215546371 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215546390 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215546403 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215546403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215546403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:55:49.514703 run osmo-msc_10.42.42.6(pid=18507): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18507)] 21:55:49.566276 run osmo-msc_10.42.42.6(pid=18507): stdout: | (launched: 2022-12-08_21:55:48.351412) 21:55:49.619369 run osmo-msc_10.42.42.6(pid=18507): stderr: | 20221208215548675 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208215548676 DLGLOBAL DEBUG validating counter group 0x7f61b19bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208215548676 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208215548676 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208215548676 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208215548676 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208215548678 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208215548678 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208215548678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208215548678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:55:49.672502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18500): Terminating (SIGTERM) 21:55:49.715180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18503): Terminating (SIGTERM) 21:55:49.758016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18506): Terminating (SIGTERM) 21:55:49.800878 --- ParallelTerminationStrategy: PID 18500 died... 21:55:49.821336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18500): Terminated: ok {rc=0} 21:55:49.868747 --- ParallelTerminationStrategy: PID 18503 died... 21:55:49.888440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18503): Terminated: ok {rc=0} 21:55:49.935808 --- ParallelTerminationStrategy: PID 18506 died... 21:55:49.955717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18506): Terminated: ok {rc=0} 21:55:50.044857 bus /sierra_3: Setting Powered False 21:55:51.143367 bus /sierra_3: Setting Powered False 21:55:52.258240 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 21:55:53.495275 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:55:53.502065 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 21:55:53.523912 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 21:55:53.552766 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 21:55:53.605199 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 21:55:53.625938 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 21:55:53.653658 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 21:55:54.202934 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 21:55:54.253170 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:55:54.264216 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:55:54.319812 tst mo_mt_call.py: using LAC 17004 21:55:54.440995 tst mo_mt_call.py: using RAC 174 21:55:54.564459 tst mo_mt_call.py: using CellId 17004 21:55:54.693638 tst mo_mt_call.py: using BVCI 17005 21:55:54.806601 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:55:54.817980 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:55:54.829019 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:55:54.840144 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:55:54.851413 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:55:54.862555 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:55:54.982204 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:55:55.097413 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:55:55.571745 run create_hlr_db(pid=18512): Launched 21:55:55.697089 bus /sierra_2: Setting Powered False 21:55:56.758728 run create_hlr_db(pid=18512): Terminated: ok {rc=0} 21:55:57.183714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18514): Launched 21:55:57.489152 run osmo-hlr_10.42.42.2(pid=18515): Launched 21:55:57.604681 run osmo-stp_10.42.42.5: Starting osmo-stp 21:55:58.130901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18517): Launched 21:55:58.436436 run osmo-stp_10.42.42.5(pid=18518): Launched 21:55:58.552336 run osmo-msc_10.42.42.6: Starting osmo-msc 21:55:59.103819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18520): Launched 21:55:59.410323 run osmo-msc_10.42.42.6(pid=18521): Launched 21:55:59.581044 run osmo-stp_10.42.42.5(pid=18518): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18518)] 21:55:59.710824 run osmo-stp_10.42.42.5(pid=18518): stdout: | (launched: 2022-12-08_21:55:58.380440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:59.840861 run osmo-stp_10.42.42.5(pid=18518): stderr: | 20221208215558553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215558553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215558554 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215558554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215558554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215558555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215558555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:59.968807 run osmo-stp_10.42.42.5(pid=18518): stdout: | (launched: 2022-12-08_21:55:58.380440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:00.091768 run osmo-stp_10.42.42.5(pid=18518): stderr: | 20221208215558553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215558553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215558554 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215558554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215558554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215558555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215558555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:00.237932 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18518): Process ended prematurely: osmo-stp_10.42.42.5(pid=18518) [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18518)] [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 21:56:00.246864 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 21:56:00.273836 run osmo-hlr_10.42.42.2(pid=18515): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18515)] 21:56:00.322645 run osmo-hlr_10.42.42.2(pid=18515): stdout: | (launched: 2022-12-08_21:55:57.433217) 21:56:00.372896 run osmo-hlr_10.42.42.2(pid=18515): stderr: | 20221208215557609 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215557609 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215557609 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215557609 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215557609 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215557609 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215557622 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215557630 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215557631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215557631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:56:00.443192 run osmo-msc_10.42.42.6(pid=18521): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18521)] 21:56:00.491558 run osmo-msc_10.42.42.6(pid=18521): stdout: | (launched: 2022-12-08_21:55:59.353857) 21:56:00.541583 run osmo-msc_10.42.42.6(pid=18521): stderr: | 20221208215559629 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208215559629 DLGLOBAL DEBUG validating counter group 0x7fc656ac0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208215559629 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208215559629 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208215559629 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208215559629 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208215559631 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208215559631 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208215559631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208215559632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:56:00.591968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18514): Terminating (SIGTERM) 21:56:00.631986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18517): Terminating (SIGTERM) 21:56:00.672058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18520): Terminating (SIGTERM) 21:56:00.712408 --- ParallelTerminationStrategy: PID 18514 died... 21:56:00.731867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18514): Terminated: ok {rc=0} 21:56:00.776878 --- ParallelTerminationStrategy: PID 18517 died... 21:56:00.796185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18517): Terminated: ok {rc=0} 21:56:00.862593 --- ParallelTerminationStrategy: PID 18520 died... 21:56:00.886756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18520): Terminated: ok {rc=0} 21:56:00.977678 bus /sierra_3: Setting Powered False 21:56:02.081641 bus /sierra_3: Setting Powered False 21:56:03.200721 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 21:56:04.352327 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:56:04.364517 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:56:04.422631 tst mo_mt_call_osmux.py: using LAC 17005 21:56:04.552232 tst mo_mt_call_osmux.py: using RAC 175 21:56:04.680916 tst mo_mt_call_osmux.py: using CellId 17005 21:56:04.816433 tst mo_mt_call_osmux.py: using BVCI 17006 21:56:04.930122 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:56:04.941351 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:56:04.952238 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:56:04.963195 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:56:04.974272 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:56:04.985384 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:56:05.104013 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:56:05.219477 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:56:05.696593 run create_hlr_db(pid=18523): Launched 21:56:05.822368 bus /sierra_2: Setting Powered False 21:56:06.883882 run create_hlr_db(pid=18523): Terminated: ok {rc=0} 21:56:07.333769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18525): Launched 21:56:07.662541 run osmo-hlr_10.42.42.2(pid=18526): Launched 21:56:07.787649 run osmo-stp_10.42.42.5: Starting osmo-stp 21:56:08.358301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18528): Launched 21:56:08.685926 run osmo-stp_10.42.42.5(pid=18529): Launched 21:56:08.811137 run osmo-msc_10.42.42.6: Starting osmo-msc 21:56:09.402518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18531): Launched 21:56:09.730596 run osmo-msc_10.42.42.6(pid=18532): Launched 21:56:09.913681 run osmo-stp_10.42.42.5(pid=18529): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18529)] 21:56:10.052599 run osmo-stp_10.42.42.5(pid=18529): stdout: | (launched: 2022-12-08_21:56:08.626027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:10.192028 run osmo-stp_10.42.42.5(pid=18529): stderr: | 20221208215608817 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215608817 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215608817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215608818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215608818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215608818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215608818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:10.331561 run osmo-stp_10.42.42.5(pid=18529): stdout: | (launched: 2022-12-08_21:56:08.626027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:10.462830 run osmo-stp_10.42.42.5(pid=18529): stderr: | 20221208215608817 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215608817 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215608817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215608818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215608818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215608818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215608818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:10.619683 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18529): Process ended prematurely: osmo-stp_10.42.42.5(pid=18529) [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18529)] [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 21:56:10.629401 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 21:56:10.658453 run osmo-hlr_10.42.42.2(pid=18526): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18526)] 21:56:10.710311 run osmo-hlr_10.42.42.2(pid=18526): stdout: | (launched: 2022-12-08_21:56:07.603028) 21:56:10.763468 run osmo-hlr_10.42.42.2(pid=18526): stderr: | 20221208215607800 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215607800 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215607800 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215607800 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215607800 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215607800 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215607813 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215607821 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215607822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215607822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:56:10.837274 run osmo-msc_10.42.42.6(pid=18532): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18532)] 21:56:10.888707 run osmo-msc_10.42.42.6(pid=18532): stdout: | (launched: 2022-12-08_21:56:09.670617) 21:56:10.941587 run osmo-msc_10.42.42.6(pid=18532): stderr: | 20221208215609991 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208215609992 DLGLOBAL DEBUG validating counter group 0x7ff9b0c00c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208215609992 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208215609992 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208215609992 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208215609992 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208215609994 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208215609994 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208215609994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208215609994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:56:10.994844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18525): Terminating (SIGTERM) 21:56:11.037495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18528): Terminating (SIGTERM) 21:56:11.080657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18531): Terminating (SIGTERM) 21:56:11.123991 --- ParallelTerminationStrategy: PID 18525 died... 21:56:11.144614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18525): Terminated: ok {rc=0} 21:56:11.192613 --- ParallelTerminationStrategy: PID 18528 died... 21:56:11.212755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18528): Terminated: ok {rc=0} 21:56:11.260541 --- ParallelTerminationStrategy: PID 18531 died... 21:56:11.280784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18531): Terminated: ok {rc=0} 21:56:11.371233 bus /sierra_3: Setting Powered False 21:56:12.471879 bus /sierra_3: Setting Powered False 21:56:13.592339 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 21:56:14.831306 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:56:14.838230 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 21:56:14.859183 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 21:56:14.886221 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 21:56:14.940781 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 21:56:14.962422 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 21:56:14.989911 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 21:56:15.538861 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 21:56:15.591704 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:15.603197 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 21:56:15.662901 tst mo_mt_call.py: using LAC 17006 21:56:15.792725 tst mo_mt_call.py: using RAC 176 21:56:15.922413 tst mo_mt_call.py: using CellId 17006 21:56:16.060259 tst mo_mt_call.py: using BVCI 17007 21:56:16.222000 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:16.233529 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:16.245209 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:16.257899 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:16.269791 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:16.281534 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:56:16.397617 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:56:16.521420 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:56:17.025507 run create_hlr_db(pid=18537): Launched 21:56:17.177357 bus /sierra_2: Setting Powered False 21:56:18.239263 run create_hlr_db(pid=18537): Terminated: ok {rc=0} 21:56:18.665685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18539): Launched 21:56:18.972601 run osmo-hlr_10.42.42.2(pid=18540): Launched 21:56:19.088562 run osmo-stp_10.42.42.5: Starting osmo-stp 21:56:19.628052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18542): Launched 21:56:19.933995 run osmo-stp_10.42.42.5(pid=18543): Launched 21:56:20.050036 run osmo-msc_10.42.42.6: Starting osmo-msc 21:56:20.603756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18545): Launched 21:56:20.910015 run osmo-msc_10.42.42.6(pid=18546): Launched 21:56:21.080151 run osmo-stp_10.42.42.5(pid=18543): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18543)] 21:56:21.210259 run osmo-stp_10.42.42.5(pid=18543): stdout: | (launched: 2022-12-08_21:56:19.877955) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:21.340142 run osmo-stp_10.42.42.5(pid=18543): stderr: | 20221208215620047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215620047 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215620047 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215620049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215620049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215620049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215620049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:21.468199 run osmo-stp_10.42.42.5(pid=18543): stdout: | (launched: 2022-12-08_21:56:19.877955) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:21.590685 run osmo-stp_10.42.42.5(pid=18543): stderr: | 20221208215620047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215620047 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215620047 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215620049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215620049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215620049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215620049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:21.736490 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18543): Process ended prematurely: osmo-stp_10.42.42.5(pid=18543) [trial-2350↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18543)] [trial-2350↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 21:56:21.745492 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 21:56:21.772501 run osmo-hlr_10.42.42.2(pid=18540): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18540)] 21:56:21.821497 run osmo-hlr_10.42.42.2(pid=18540): stdout: | (launched: 2022-12-08_21:56:18.916031) 21:56:21.872533 run osmo-hlr_10.42.42.2(pid=18540): stderr: | 20221208215619092 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215619092 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215619092 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215619093 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215619093 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215619093 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215619105 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215619114 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215619114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215619114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:56:21.943202 run osmo-msc_10.42.42.6(pid=18546): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18546)] 21:56:21.991854 run osmo-msc_10.42.42.6(pid=18546): stdout: | (launched: 2022-12-08_21:56:20.853857) 21:56:22.042168 run osmo-msc_10.42.42.6(pid=18546): stderr: | 20221208215621124 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208215621124 DLGLOBAL DEBUG validating counter group 0x7f2b45542c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208215621125 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208215621125 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208215621125 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208215621125 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208215621127 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208215621127 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208215621127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208215621128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:56:22.093078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18539): Terminating (SIGTERM) 21:56:22.133533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18542): Terminating (SIGTERM) 21:56:22.174007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18545): Terminating (SIGTERM) 21:56:22.215375 --- ParallelTerminationStrategy: PID 18539 died... 21:56:22.234933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18539): Terminated: ok {rc=0} 21:56:22.279881 --- ParallelTerminationStrategy: PID 18542 died... 21:56:22.298992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18542): Terminated: ok {rc=0} 21:56:22.343922 --- ParallelTerminationStrategy: PID 18545 died... 21:56:22.362971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18545): Terminated: ok {rc=0} 21:56:22.447088 bus /sierra_3: Setting Powered False 21:56:23.543831 bus /sierra_3: Setting Powered False 21:56:24.660455 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 21:56:25.809648 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:25.821156 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 21:56:25.881876 tst mo_mt_call_osmux.py: using LAC 17007 21:56:26.011367 tst mo_mt_call_osmux.py: using RAC 177 21:56:26.140680 tst mo_mt_call_osmux.py: using CellId 17007 21:56:26.269383 tst mo_mt_call_osmux.py: using BVCI 17008 21:56:26.391287 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:26.402945 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:26.414391 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:26.426309 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:26.438006 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:26.449785 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:56:26.567657 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:56:26.683724 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:56:27.158979 run create_hlr_db(pid=18548): Launched 21:56:27.284187 bus /sierra_2: Setting Powered False 21:56:28.349986 run create_hlr_db(pid=18548): Terminated: ok {rc=0} 21:56:28.806459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18550): Launched 21:56:29.134876 run osmo-hlr_10.42.42.2(pid=18551): Launched 21:56:29.259722 run osmo-stp_10.42.42.5: Starting osmo-stp 21:56:29.828146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18553): Launched 21:56:30.156005 run osmo-stp_10.42.42.5(pid=18554): Launched 21:56:30.281422 run osmo-msc_10.42.42.6: Starting osmo-msc 21:56:30.890574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18556): Launched 21:56:31.240625 run osmo-msc_10.42.42.6(pid=18557): Launched 21:56:31.587335 run osmo-stp_10.42.42.5(pid=18554): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18554)] 21:56:31.951992 run osmo-stp_10.42.42.5(pid=18554): stdout: | (launched: 2022-12-08_21:56:30.096049) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:32.283395 run osmo-stp_10.42.42.5(pid=18554): stderr: | 20221208215630289 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215630289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215630289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215630290 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215630290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215630290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215630290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:32.424100 run osmo-stp_10.42.42.5(pid=18554): stdout: | (launched: 2022-12-08_21:56:30.096049) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:32.555175 run osmo-stp_10.42.42.5(pid=18554): stderr: | 20221208215630289 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215630289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215630289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215630290 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215630290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215630290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215630290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:32.712057 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18554): Process ended prematurely: osmo-stp_10.42.42.5(pid=18554) [trial-2350↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18554)] [trial-2350↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 21:56:32.722080 tst mo_mt_call_osmux.py:8: Test FAILED (6.9 sec) 21:56:32.751260 run osmo-hlr_10.42.42.2(pid=18551): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18551)] 21:56:32.802925 run osmo-hlr_10.42.42.2(pid=18551): stdout: | (launched: 2022-12-08_21:56:29.075192) 21:56:32.856213 run osmo-hlr_10.42.42.2(pid=18551): stderr: | 20221208215629275 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215629275 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215629275 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215629275 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215629275 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215629275 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215629289 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215629297 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215629297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215629297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:56:32.930303 run osmo-msc_10.42.42.6(pid=18557): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18557)] 21:56:32.981885 run osmo-msc_10.42.42.6(pid=18557): stdout: | (launched: 2022-12-08_21:56:31.175914) 21:56:33.034916 run osmo-msc_10.42.42.6(pid=18557): stderr: | 20221208215631911 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208215631912 DLGLOBAL DEBUG validating counter group 0x7f08034d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208215631912 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208215631912 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208215631913 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208215631914 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208215631918 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208215631920 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208215631920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208215631920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:56:33.088409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18550): Terminating (SIGTERM) 21:56:33.131443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18553): Terminating (SIGTERM) 21:56:33.174570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18556): Terminating (SIGTERM) 21:56:33.217914 --- ParallelTerminationStrategy: PID 18550 died... 21:56:33.238379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18550): Terminated: ok {rc=0} 21:56:33.286665 --- ParallelTerminationStrategy: PID 18553 died... 21:56:33.306738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18553): Terminated: ok {rc=0} 21:56:33.354733 --- ParallelTerminationStrategy: PID 18556 died... 21:56:33.374818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18556): Terminated: ok {rc=0} 21:56:33.464695 bus /sierra_3: Setting Powered False 21:56:34.564292 bus /sierra_3: Setting Powered False 21:56:35.681028 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 21:56:36.916712 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:56:36.923663 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 21:56:36.944928 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 21:56:36.972819 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 21:56:37.026625 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 21:56:37.048095 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 21:56:37.075807 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 21:56:37.624613 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 21:56:37.678104 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:37.689577 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:56:37.746617 tst mo_mt_call.py: using LAC 17008 21:56:37.878076 tst mo_mt_call.py: using RAC 178 21:56:38.007478 tst mo_mt_call.py: using CellId 17008 21:56:38.138414 tst mo_mt_call.py: using BVCI 17009 21:56:38.258281 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:38.269922 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:38.281466 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:38.292914 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:38.304589 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:38.316306 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:56:38.435354 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:56:38.551795 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:56:39.061705 run create_hlr_db(pid=18562): Launched 21:56:39.186326 bus /sierra_2: Setting Powered False 21:56:40.251808 run create_hlr_db(pid=18562): Terminated: ok {rc=0} 21:56:40.691309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18564): Launched 21:56:40.998117 run osmo-hlr_10.42.42.2(pid=18565): Launched 21:56:41.114478 run osmo-stp_10.42.42.5: Starting osmo-stp 21:56:41.657426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18567): Launched 21:56:41.967006 run osmo-stp_10.42.42.5(pid=18568): Launched 21:56:42.082962 run osmo-msc_10.42.42.6: Starting osmo-msc 21:56:42.638630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18570): Launched 21:56:42.945841 run osmo-msc_10.42.42.6(pid=18571): Launched 21:56:43.117974 run osmo-stp_10.42.42.5(pid=18568): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18568)] 21:56:43.249192 run osmo-stp_10.42.42.5(pid=18568): stdout: | (launched: 2022-12-08_21:56:41.909907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:43.379754 run osmo-stp_10.42.42.5(pid=18568): stderr: | 20221208215642082 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215642082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215642082 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215642083 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215642083 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215642083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215642083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:43.509169 run osmo-stp_10.42.42.5(pid=18568): stdout: | (launched: 2022-12-08_21:56:41.909907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:43.632249 run osmo-stp_10.42.42.5(pid=18568): stderr: | 20221208215642082 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215642082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215642082 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215642083 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215642083 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215642083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215642083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:43.779578 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18568): Process ended prematurely: osmo-stp_10.42.42.5(pid=18568) [trial-2350↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18568)] [trial-2350↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 21:56:43.788668 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 21:56:43.816005 run osmo-hlr_10.42.42.2(pid=18565): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18565)] 21:56:43.865357 run osmo-hlr_10.42.42.2(pid=18565): stdout: | (launched: 2022-12-08_21:56:40.942059) 21:56:43.916342 run osmo-hlr_10.42.42.2(pid=18565): stderr: | 20221208215641117 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215641117 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215641117 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215641117 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215641117 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215641117 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215641129 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215641138 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215641138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215641138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:56:43.987382 run osmo-msc_10.42.42.6(pid=18571): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18571)] 21:56:44.036537 run osmo-msc_10.42.42.6(pid=18571): stdout: | (launched: 2022-12-08_21:56:42.889443) 21:56:44.087007 run osmo-msc_10.42.42.6(pid=18571): stderr: | 20221208215643163 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208215643164 DLGLOBAL DEBUG validating counter group 0x7fac7f5b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208215643164 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208215643164 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208215643164 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208215643164 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208215643166 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208215643166 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208215643167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208215643167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:56:44.138473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18564): Terminating (SIGTERM) 21:56:44.179269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18567): Terminating (SIGTERM) 21:56:44.220120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18570): Terminating (SIGTERM) 21:56:44.261222 --- ParallelTerminationStrategy: PID 18564 died... 21:56:44.280775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18564): Terminated: ok {rc=0} 21:56:44.326492 --- ParallelTerminationStrategy: PID 18567 died... 21:56:44.345854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18567): Terminated: ok {rc=0} 21:56:44.391834 --- ParallelTerminationStrategy: PID 18570 died... 21:56:44.411027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18570): Terminated: ok {rc=0} 21:56:44.498248 bus /sierra_3: Setting Powered False 21:56:45.599303 bus /sierra_3: Setting Powered False 21:56:46.715259 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 21:56:47.860146 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:47.871761 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:56:47.927803 tst mo_mt_call_osmux.py: using LAC 17009 21:56:48.050562 tst mo_mt_call_osmux.py: using RAC 179 21:56:48.173779 tst mo_mt_call_osmux.py: using CellId 17009 21:56:48.294656 tst mo_mt_call_osmux.py: using BVCI 17010 21:56:48.408793 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:48.420239 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:48.431274 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:48.442510 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:48.453662 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:48.464778 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:56:48.584764 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:56:48.700643 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:56:49.177114 run create_hlr_db(pid=18573): Launched 21:56:49.301537 bus /sierra_2: Setting Powered False 21:56:50.363225 run create_hlr_db(pid=18573): Terminated: ok {rc=0} 21:56:50.811604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18575): Launched 21:56:51.140765 run osmo-hlr_10.42.42.2(pid=18576): Launched 21:56:51.266620 run osmo-stp_10.42.42.5: Starting osmo-stp 21:56:51.839057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18578): Launched 21:56:52.169401 run osmo-stp_10.42.42.5(pid=18579): Launched 21:56:52.296289 run osmo-msc_10.42.42.6: Starting osmo-msc 21:56:52.893347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18581): Launched 21:56:53.222203 run osmo-msc_10.42.42.6(pid=18582): Launched 21:56:53.405494 run osmo-stp_10.42.42.5(pid=18579): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18579)] 21:56:53.545841 run osmo-stp_10.42.42.5(pid=18579): stdout: | (launched: 2022-12-08_21:56:52.109393) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:53.685404 run osmo-stp_10.42.42.5(pid=18579): stderr: | 20221208215652303 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215652303 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215652303 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215652304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215652304 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215652304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215652304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:53.823803 run osmo-stp_10.42.42.5(pid=18579): stdout: | (launched: 2022-12-08_21:56:52.109393) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:53.955159 run osmo-stp_10.42.42.5(pid=18579): stderr: | 20221208215652303 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215652303 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215652303 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215652304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215652304 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215652304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215652304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:54.112407 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18579): Process ended prematurely: osmo-stp_10.42.42.5(pid=18579) [trial-2350↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18579)] [trial-2350↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 21:56:54.122407 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 21:56:54.151579 run osmo-hlr_10.42.42.2(pid=18576): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18576)] 21:56:54.203260 run osmo-hlr_10.42.42.2(pid=18576): stdout: | (launched: 2022-12-08_21:56:51.080889) 21:56:54.256824 run osmo-hlr_10.42.42.2(pid=18576): stderr: | 20221208215651280 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215651280 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215651280 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215651280 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215651280 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215651280 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215651292 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215651300 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215651300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215651300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:56:54.331563 run osmo-msc_10.42.42.6(pid=18582): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18582)] 21:56:54.383338 run osmo-msc_10.42.42.6(pid=18582): stdout: | (launched: 2022-12-08_21:56:53.162258) 21:56:54.436592 run osmo-msc_10.42.42.6(pid=18582): stderr: | 20221208215653487 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208215653487 DLGLOBAL DEBUG validating counter group 0x7f11ba186c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208215653487 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208215653487 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208215653487 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208215653488 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208215653489 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208215653490 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208215653490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208215653490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:56:54.490653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18575): Terminating (SIGTERM) 21:56:54.533886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18578): Terminating (SIGTERM) 21:56:54.577267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18581): Terminating (SIGTERM) 21:56:54.620841 --- ParallelTerminationStrategy: PID 18575 died... 21:56:54.641464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18575): Terminated: ok {rc=0} 21:56:54.689762 --- ParallelTerminationStrategy: PID 18578 died... 21:56:54.709917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18578): Terminated: ok {rc=0} 21:56:54.757962 --- ParallelTerminationStrategy: PID 18581 died... 21:56:54.778000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18581): Terminated: ok {rc=0} 21:56:54.867532 bus /sierra_3: Setting Powered False 21:56:55.966503 bus /sierra_3: Setting Powered False 21:56:57.082838 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 21:56:58.322238 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:56:58.328852 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:56:58.349627 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 21:56:58.375972 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:56:58.426666 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:56:58.446861 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 21:56:58.472922 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:56:59.027031 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 21:56:59.080070 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:56:59.091626 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:56:59.151725 tst mo_mt_call.py: using LAC 17010 21:56:59.281145 tst mo_mt_call.py: using RAC 180 21:56:59.409752 tst mo_mt_call.py: using CellId 17010 21:56:59.537272 tst mo_mt_call.py: using BVCI 17011 21:56:59.657086 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:56:59.668794 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:56:59.680251 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:56:59.692030 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:56:59.704012 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:56:59.715857 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:56:59.835657 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:56:59.955175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:57:00.465109 run create_hlr_db(pid=18587): Launched 21:57:00.590277 bus /sierra_2: Setting Powered False 21:57:01.650649 run create_hlr_db(pid=18587): Terminated: ok {rc=0} 21:57:02.147021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18589): Launched 21:57:02.466685 run osmo-hlr_10.42.42.2(pid=18590): Launched 21:57:02.585115 run osmo-stp_10.42.42.5: Starting osmo-stp 21:57:03.112564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18592): Launched 21:57:03.420565 run osmo-stp_10.42.42.5(pid=18593): Launched 21:57:03.537996 run osmo-msc_10.42.42.6: Starting osmo-msc 21:57:04.092624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18595): Launched 21:57:04.401311 run osmo-msc_10.42.42.6(pid=18596): Launched 21:57:04.574230 run osmo-stp_10.42.42.5(pid=18593): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18593)] 21:57:04.704733 run osmo-stp_10.42.42.5(pid=18593): stdout: | (launched: 2022-12-08_21:57:03.363888) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:04.835429 run osmo-stp_10.42.42.5(pid=18593): stderr: | 20221208215703535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215703535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215703536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215703536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215703537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215703537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215703537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:04.963813 run osmo-stp_10.42.42.5(pid=18593): stdout: | (launched: 2022-12-08_21:57:03.363888) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:05.086377 run osmo-stp_10.42.42.5(pid=18593): stderr: | 20221208215703535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215703535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215703536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215703536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215703537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215703537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215703537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:05.232709 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18593): Process ended prematurely: osmo-stp_10.42.42.5(pid=18593) [trial-2350↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18593)] [trial-2350↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 21:57:05.241934 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 21:57:05.269165 run osmo-hlr_10.42.42.2(pid=18590): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18590)] 21:57:05.318533 run osmo-hlr_10.42.42.2(pid=18590): stdout: | (launched: 2022-12-08_21:57:02.410805) 21:57:05.369328 run osmo-hlr_10.42.42.2(pid=18590): stderr: | 20221208215702588 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215702588 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215702588 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215702588 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215702588 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215702588 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215702605 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215702615 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215702615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215702615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:57:05.440375 run osmo-msc_10.42.42.6(pid=18596): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18596)] 21:57:05.489339 run osmo-msc_10.42.42.6(pid=18596): stdout: | (launched: 2022-12-08_21:57:04.344410) 21:57:05.539925 run osmo-msc_10.42.42.6(pid=18596): stderr: | 20221208215704621 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208215704621 DLGLOBAL DEBUG validating counter group 0x7fcb0d0e1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208215704621 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208215704621 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208215704621 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208215704622 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208215704623 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208215704624 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208215704624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208215704624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:57:05.590877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18589): Terminating (SIGTERM) 21:57:05.631369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18592): Terminating (SIGTERM) 21:57:05.672018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18595): Terminating (SIGTERM) 21:57:05.713077 --- ParallelTerminationStrategy: PID 18589 died... 21:57:05.732592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18589): Terminated: ok {rc=0} 21:57:05.777952 --- ParallelTerminationStrategy: PID 18592 died... 21:57:05.796940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18592): Terminated: ok {rc=0} 21:57:05.842671 --- ParallelTerminationStrategy: PID 18595 died... 21:57:05.861837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18595): Terminated: ok {rc=0} 21:57:05.948813 bus /sierra_3: Setting Powered False 21:57:07.050364 bus /sierra_3: Setting Powered False 21:57:08.167799 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 21:57:09.322714 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:09.334959 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:57:09.394251 tst mo_mt_call_osmux.py: using LAC 17011 21:57:09.524920 tst mo_mt_call_osmux.py: using RAC 181 21:57:09.654580 tst mo_mt_call_osmux.py: using CellId 17011 21:57:09.788151 tst mo_mt_call_osmux.py: using BVCI 17012 21:57:09.901642 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:09.912839 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:09.923920 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:09.934908 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:09.945895 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:09.957005 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:57:10.075623 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:57:10.193247 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:57:10.705627 run create_hlr_db(pid=18598): Launched 21:57:10.832278 bus /sierra_2: Setting Powered False 21:57:11.898580 run create_hlr_db(pid=18598): Terminated: ok {rc=0} 21:57:12.338057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18600): Launched 21:57:12.646246 run osmo-hlr_10.42.42.2(pid=18601): Launched 21:57:12.762823 run osmo-stp_10.42.42.5: Starting osmo-stp 21:57:13.296706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18603): Launched 21:57:13.603867 run osmo-stp_10.42.42.5(pid=18604): Launched 21:57:13.720899 run osmo-msc_10.42.42.6: Starting osmo-msc 21:57:14.274986 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18606): Launched 21:57:14.582563 run osmo-msc_10.42.42.6(pid=18607): Launched 21:57:14.754699 run osmo-stp_10.42.42.5(pid=18604): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18604)] 21:57:14.884536 run osmo-stp_10.42.42.5(pid=18604): stdout: | (launched: 2022-12-08_21:57:13.547291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:15.014401 run osmo-stp_10.42.42.5(pid=18604): stderr: | 20221208215713721 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215713721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215713721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215713722 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215713722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215713722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215713722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:15.143127 run osmo-stp_10.42.42.5(pid=18604): stdout: | (launched: 2022-12-08_21:57:13.547291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:15.265253 run osmo-stp_10.42.42.5(pid=18604): stderr: | 20221208215713721 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215713721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215713721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215713722 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215713722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215713722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215713722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:15.410980 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18604): Process ended prematurely: osmo-stp_10.42.42.5(pid=18604) [trial-2350↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18604)] [trial-2350↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 21:57:15.419806 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 21:57:15.446771 run osmo-hlr_10.42.42.2(pid=18601): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18601)] 21:57:15.495515 run osmo-hlr_10.42.42.2(pid=18601): stdout: | (launched: 2022-12-08_21:57:12.589725) 21:57:15.545730 run osmo-hlr_10.42.42.2(pid=18601): stderr: | 20221208215712765 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215712765 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215712765 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215712766 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215712766 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215712766 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215712778 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215712789 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215712789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215712789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:57:15.616214 run osmo-msc_10.42.42.6(pid=18607): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18607)] 21:57:15.664774 run osmo-msc_10.42.42.6(pid=18607): stdout: | (launched: 2022-12-08_21:57:14.525909) 21:57:15.715086 run osmo-msc_10.42.42.6(pid=18607): stderr: | 20221208215714799 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208215714799 DLGLOBAL DEBUG validating counter group 0x7f7119527c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208215714799 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208215714799 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208215714799 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208215714799 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208215714801 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208215714802 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208215714802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208215714802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:57:15.766526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18600): Terminating (SIGTERM) 21:57:15.806975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18603): Terminating (SIGTERM) 21:57:15.847720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18606): Terminating (SIGTERM) 21:57:15.891029 --- ParallelTerminationStrategy: PID 18600 died... 21:57:15.924816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18600): Terminated: ok {rc=0} 21:57:15.970818 --- ParallelTerminationStrategy: PID 18603 died... 21:57:15.990578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18603): Terminated: ok {rc=0} 21:57:16.036458 --- ParallelTerminationStrategy: PID 18606 died... 21:57:16.062103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18606): Terminated: ok {rc=0} 21:57:16.166071 bus /sierra_3: Setting Powered False 21:57:17.277650 bus /sierra_3: Setting Powered False 21:57:18.394386 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 21:57:19.628409 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:57:19.633859 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 21:57:19.653977 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 21:57:19.679989 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 21:57:19.731108 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 21:57:19.751100 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 21:57:19.777118 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 21:57:20.325900 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 21:57:20.374884 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:20.385690 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:57:20.442194 tst mo_mt_call.py: using LAC 17012 21:57:20.564418 tst mo_mt_call.py: using RAC 182 21:57:20.686782 tst mo_mt_call.py: using CellId 17012 21:57:20.807179 tst mo_mt_call.py: using BVCI 17013 21:57:20.920112 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:20.930977 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:20.941568 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:20.952043 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:20.962793 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:20.973367 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:57:21.092618 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:57:21.209436 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:57:21.683980 run create_hlr_db(pid=18614): Launched 21:57:21.808705 bus /sierra_2: Setting Powered False 21:57:22.870223 run create_hlr_db(pid=18614): Terminated: ok {rc=0} 21:57:23.318774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18616): Launched 21:57:23.628791 run osmo-hlr_10.42.42.2(pid=18617): Launched 21:57:23.745075 run osmo-stp_10.42.42.5: Starting osmo-stp 21:57:24.276045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18619): Launched 21:57:24.582990 run osmo-stp_10.42.42.5(pid=18620): Launched 21:57:24.699457 run osmo-msc_10.42.42.6: Starting osmo-msc 21:57:25.255300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18622): Launched 21:57:25.562591 run osmo-msc_10.42.42.6(pid=18623): Launched 21:57:25.732637 run osmo-stp_10.42.42.5(pid=18620): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18620)] 21:57:25.863146 run osmo-stp_10.42.42.5(pid=18620): stdout: | (launched: 2022-12-08_21:57:24.526425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:25.992498 run osmo-stp_10.42.42.5(pid=18620): stderr: | 20221208215724700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215724700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215724701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215724701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215724701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215724701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215724702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:26.120526 run osmo-stp_10.42.42.5(pid=18620): stdout: | (launched: 2022-12-08_21:57:24.526425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:26.242625 run osmo-stp_10.42.42.5(pid=18620): stderr: | 20221208215724700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215724700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215724701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215724701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215724701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215724701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215724702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:26.388661 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18620): Process ended prematurely: osmo-stp_10.42.42.5(pid=18620) [trial-2350↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18620)] [trial-2350↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 21:57:26.397517 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 21:57:26.424278 run osmo-hlr_10.42.42.2(pid=18617): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18617)] 21:57:26.472865 run osmo-hlr_10.42.42.2(pid=18617): stdout: | (launched: 2022-12-08_21:57:23.572544) 21:57:26.523285 run osmo-hlr_10.42.42.2(pid=18617): stderr: | 20221208215723750 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215723750 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215723750 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215723750 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215723750 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215723751 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215723763 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215723773 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215723774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215723774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:57:26.594134 run osmo-msc_10.42.42.6(pid=18623): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18623)] 21:57:26.643128 run osmo-msc_10.42.42.6(pid=18623): stdout: | (launched: 2022-12-08_21:57:25.505497) 21:57:26.693626 run osmo-msc_10.42.42.6(pid=18623): stderr: | 20221208215725779 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208215725779 DLGLOBAL DEBUG validating counter group 0x7f5454291c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208215725779 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208215725779 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208215725779 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208215725779 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208215725783 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208215725783 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208215725783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208215725783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:57:26.744784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18616): Terminating (SIGTERM) 21:57:26.785198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18619): Terminating (SIGTERM) 21:57:26.825672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18622): Terminating (SIGTERM) 21:57:26.866385 --- ParallelTerminationStrategy: PID 18616 died... 21:57:26.885761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18616): Terminated: ok {rc=0} 21:57:26.930873 --- ParallelTerminationStrategy: PID 18619 died... 21:57:26.949990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18619): Terminated: ok {rc=0} 21:57:26.994810 --- ParallelTerminationStrategy: PID 18622 died... 21:57:27.013774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18622): Terminated: ok {rc=0} 21:57:27.102119 bus /sierra_3: Setting Powered False 21:57:28.204525 bus /sierra_3: Setting Powered False 21:57:29.323378 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 21:57:30.473992 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:30.485786 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:57:30.543927 tst mo_mt_call_osmux.py: using LAC 17013 21:57:30.675392 tst mo_mt_call_osmux.py: using RAC 183 21:57:30.803962 tst mo_mt_call_osmux.py: using CellId 17013 21:57:30.962151 tst mo_mt_call_osmux.py: using BVCI 17014 21:57:31.083413 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:31.096215 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:31.110163 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:31.125438 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:31.139000 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:31.153766 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:57:31.296875 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:57:31.418893 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:57:31.915829 run create_hlr_db(pid=18625): Launched 21:57:32.093803 bus /sierra_2: Setting Powered False 21:57:33.159107 run create_hlr_db(pid=18625): Terminated: ok {rc=0} 21:57:33.600676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18627): Launched 21:57:33.908836 run osmo-hlr_10.42.42.2(pid=18628): Launched 21:57:34.025267 run osmo-stp_10.42.42.5: Starting osmo-stp 21:57:34.569990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18630): Launched 21:57:34.877685 run osmo-stp_10.42.42.5(pid=18631): Launched 21:57:34.993470 run osmo-msc_10.42.42.6: Starting osmo-msc 21:57:35.552070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18633): Launched 21:57:35.860601 run osmo-msc_10.42.42.6(pid=18639): Launched 21:57:36.032692 run osmo-stp_10.42.42.5(pid=18631): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18631)] 21:57:36.163672 run osmo-stp_10.42.42.5(pid=18631): stdout: | (launched: 2022-12-08_21:57:34.820909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:36.293970 run osmo-stp_10.42.42.5(pid=18631): stderr: | 20221208215734991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215734992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215734992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215734992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215734995 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215734995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215734995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:36.422069 run osmo-stp_10.42.42.5(pid=18631): stdout: | (launched: 2022-12-08_21:57:34.820909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:36.544061 run osmo-stp_10.42.42.5(pid=18631): stderr: | 20221208215734991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215734992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215734992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215734992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215734995 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215734995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215734995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:36.690740 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18631): Process ended prematurely: osmo-stp_10.42.42.5(pid=18631) [trial-2350↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18631)] [trial-2350↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 21:57:36.699527 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 21:57:36.726489 run osmo-hlr_10.42.42.2(pid=18628): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18628)] 21:57:36.775238 run osmo-hlr_10.42.42.2(pid=18628): stdout: | (launched: 2022-12-08_21:57:33.852043) 21:57:36.826076 run osmo-hlr_10.42.42.2(pid=18628): stderr: | 20221208215734030 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215734030 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215734030 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215734030 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215734030 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215734031 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215734042 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215734053 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215734053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215734053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:57:36.896321 run osmo-msc_10.42.42.6(pid=18639): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18639)] 21:57:36.945214 run osmo-msc_10.42.42.6(pid=18639): stdout: | (launched: 2022-12-08_21:57:35.803881) 21:57:36.995336 run osmo-msc_10.42.42.6(pid=18639): stderr: | 20221208215736075 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208215736076 DLGLOBAL DEBUG validating counter group 0x7f5018a41c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208215736076 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208215736076 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208215736076 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208215736076 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208215736078 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208215736078 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208215736078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208215736078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:57:37.045912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18627): Terminating (SIGTERM) 21:57:37.085949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18630): Terminating (SIGTERM) 21:57:37.126090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18633): Terminating (SIGTERM) 21:57:37.166706 --- ParallelTerminationStrategy: PID 18627 died... 21:57:37.185979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18627): Terminated: ok {rc=0} 21:57:37.230455 --- ParallelTerminationStrategy: PID 18630 died... 21:57:37.249407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18630): Terminated: ok {rc=0} 21:57:37.294487 --- ParallelTerminationStrategy: PID 18633 died... 21:57:37.313404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18633): Terminated: ok {rc=0} 21:57:37.400109 bus /sierra_3: Setting Powered False 21:57:38.501898 bus /sierra_3: Setting Powered False 21:57:39.618591 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 emergency:oc2g --------------------------------------------------------------------- 21:57:40.852456 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:57:40.857433 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 21:57:40.878069 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 21:57:40.904318 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 21:57:40.987623 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 21:57:41.007717 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 21:57:41.033757 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 21:57:41.615294 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2350 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 21:57:41.620095 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:41.630532 tst emergency:oc2g: Using 1 x bts (candidates: 1) 21:57:41.664914 tst emergency_mo_mt_call.py: using LAC 17014 21:57:41.783180 tst emergency_mo_mt_call.py: using RAC 184 21:57:41.902347 tst emergency_mo_mt_call.py: using CellId 17014 21:57:42.021892 tst emergency_mo_mt_call.py: using BVCI 17015 21:57:42.130695 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:42.141237 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:42.151618 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:42.161931 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:42.172108 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:42.182402 tst emergency:oc2g: Using 1 x modem (candidates: 4) 21:57:42.298486 tst emergency:oc2g: Using 1 x modem (candidates: 4) 21:57:42.413517 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:57:42.883061 run create_hlr_db(pid=18644): Launched 21:57:43.005420 bus /sierra_2: Setting Powered False 21:57:44.065672 run create_hlr_db(pid=18644): Terminated: ok {rc=0} 21:57:44.507829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18646): Launched 21:57:44.830652 run osmo-hlr_10.42.42.2(pid=18647): Launched 21:57:44.953096 run osmo-stp_10.42.42.5: Starting osmo-stp 21:57:45.508681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18649): Launched 21:57:45.832315 run osmo-stp_10.42.42.5(pid=18650): Launched 21:57:46.034296 tst emergency_mo_mt_call.py: using MSISDN 6874 21:57:46.314184 run osmo-msc_10.42.42.6: Starting osmo-msc 21:57:46.889708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18652): Launched 21:57:47.210309 run osmo-msc_10.42.42.6(pid=18653): Launched 21:57:47.433114 run osmo-stp_10.42.42.5(pid=18650): ERR: Terminated: ERROR {rc=1} [trial-2350↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18650)] 21:57:47.569608 run osmo-stp_10.42.42.5(pid=18650): stdout: | (launched: 2022-12-08_21:57:45.772270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:47.705800 run osmo-stp_10.42.42.5(pid=18650): stderr: | 20221208215746086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215746086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215746086 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215746087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215746087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215746087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215746087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:47.841473 run osmo-stp_10.42.42.5(pid=18650): stdout: | (launched: 2022-12-08_21:57:45.772270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:47.970512 run osmo-stp_10.42.42.5(pid=18650): stderr: | 20221208215746086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215746086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215746086 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215746087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215746087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215746087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215746087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:48.124750 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=18650): Process ended prematurely: osmo-stp_10.42.42.5(pid=18650) [trial-2350↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18650)] [trial-2350↪emergency:oc2g↪emergency_mo_mt_call.py:19] 21:57:48.133847 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 21:57:48.162245 run osmo-hlr_10.42.42.2(pid=18647): ERR: Terminated: ERROR {rc=237} [trial-2350↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18647)] 21:57:48.213584 run osmo-hlr_10.42.42.2(pid=18647): stdout: | (launched: 2022-12-08_21:57:44.771694) 21:57:48.266850 run osmo-hlr_10.42.42.2(pid=18647): stderr: | 20221208215744970 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215744970 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215744970 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215744970 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215744970 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215744970 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215744982 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215744990 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215744990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215744990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:57:48.341390 run osmo-msc_10.42.42.6(pid=18653): ERR: Terminated: ERROR {rc=2} [trial-2350↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18653)] 21:57:48.393218 run osmo-msc_10.42.42.6(pid=18653): stdout: | (launched: 2022-12-08_21:57:47.147841) 21:57:48.446486 run osmo-msc_10.42.42.6(pid=18653): stderr: | 20221208215747520 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208215747520 DLGLOBAL DEBUG validating counter group 0x7f4d65f3ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208215747520 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208215747520 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208215747521 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208215747521 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208215747523 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208215747523 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208215747523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208215747523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:57:48.500353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18646): Terminating (SIGTERM) 21:57:48.543254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18649): Terminating (SIGTERM) 21:57:48.586653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18652): Terminating (SIGTERM) 21:57:48.630353 --- ParallelTerminationStrategy: PID 18646 died... 21:57:48.651038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18646): Terminated: ok {rc=0} 21:57:48.699216 --- ParallelTerminationStrategy: PID 18649 died... 21:57:48.719401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18649): Terminated: ok {rc=0} 21:57:48.767388 --- ParallelTerminationStrategy: PID 18652 died... 21:57:48.787389 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18652): Terminated: ok {rc=0} 21:57:48.877561 bus /sierra_3: Setting Powered False 21:57:49.979097 bus /sierra_3: Setting Powered False 21:57:51.098170 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 21:57:52.182222 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:52.193364 tst emergency:oc2g: Using 1 x bts (candidates: 1) 21:57:52.230156 tst emergency_preemptive_call.py: using LAC 17015 21:57:52.348789 tst emergency_preemptive_call.py: using RAC 185 21:57:52.489020 tst emergency_preemptive_call.py: using CellId 17015 21:57:52.617649 tst emergency_preemptive_call.py: using BVCI 17016 21:57:52.738471 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:52.749662 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:52.760665 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:52.772575 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:52.784507 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:52.796283 tst emergency:oc2g: Using 1 x modem (candidates: 4) 21:57:52.915489 tst emergency:oc2g: Using 1 x modem (candidates: 4) 21:57:53.035280 tst emergency:oc2g: Using 1 x modem (candidates: 4) 21:57:53.152201 tst emergency:oc2g: Using 1 x modem (candidates: 4) 21:57:53.271654 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:57:53.775147 run create_hlr_db(pid=18655): Launched 21:57:53.899135 bus /sierra_2: Setting Powered False 21:57:54.964051 run create_hlr_db(pid=18655): Terminated: ok {rc=0} 21:57:55.416605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18657): Launched 21:57:55.740635 run osmo-hlr_10.42.42.2(pid=18658): Launched 21:57:55.864508 run osmo-stp_10.42.42.5: Starting osmo-stp 21:57:56.419068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18660): Launched 21:57:56.742123 run osmo-stp_10.42.42.5(pid=18661): Launched 21:57:56.875546 tst emergency_preemptive_call.py: using MSISDN 6875 21:57:57.043903 run osmo-msc_10.42.42.6: Starting osmo-msc 21:57:57.622988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18663): Launched 21:57:57.945895 run osmo-msc_10.42.42.6(pid=18664): Launched 21:57:58.125216 run osmo-stp_10.42.42.5(pid=18661): ERR: Terminated: ERROR {rc=1} [trial-2350↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18661)] 21:57:58.261944 run osmo-stp_10.42.42.5(pid=18661): stdout: | (launched: 2022-12-08_21:57:56.683087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:58.399998 run osmo-stp_10.42.42.5(pid=18661): stderr: | 20221208215756875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215756875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215756875 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215756876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215756876 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215756876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215756876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:58.536485 run osmo-stp_10.42.42.5(pid=18661): stdout: | (launched: 2022-12-08_21:57:56.683087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:58.665281 run osmo-stp_10.42.42.5(pid=18661): stderr: | 20221208215756875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215756875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215756875 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215756876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215756876 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215756876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215756876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:58.819332 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=18661): Process ended prematurely: osmo-stp_10.42.42.5(pid=18661) [trial-2350↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18661)] [trial-2350↪emergency:oc2g↪emergency_preemptive_call.py:32] 21:57:58.828096 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 21:57:58.856720 run osmo-hlr_10.42.42.2(pid=18658): ERR: Terminated: ERROR {rc=237} [trial-2350↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18658)] 21:57:58.908064 run osmo-hlr_10.42.42.2(pid=18658): stdout: | (launched: 2022-12-08_21:57:55.681327) 21:57:58.961230 run osmo-hlr_10.42.42.2(pid=18658): stderr: | 20221208215755879 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215755879 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215755879 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215755879 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215755879 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215755879 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215755906 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215755916 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215755916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215755916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:57:59.035421 run osmo-msc_10.42.42.6(pid=18664): ERR: Terminated: ERROR {rc=2} [trial-2350↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18664)] 21:57:59.086716 run osmo-msc_10.42.42.6(pid=18664): stdout: | (launched: 2022-12-08_21:57:57.886751) 21:57:59.139606 run osmo-msc_10.42.42.6(pid=18664): stderr: | 20221208215758210 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208215758210 DLGLOBAL DEBUG validating counter group 0x7f1a028bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208215758210 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208215758210 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208215758210 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208215758211 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208215758212 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208215758213 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208215758213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208215758213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:57:59.193190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18657): Terminating (SIGTERM) 21:57:59.236086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18660): Terminating (SIGTERM) 21:57:59.279013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18663): Terminating (SIGTERM) 21:57:59.322394 --- ParallelTerminationStrategy: PID 18657 died... 21:57:59.342781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18657): Terminated: ok {rc=0} 21:57:59.390248 --- ParallelTerminationStrategy: PID 18660 died... 21:57:59.410051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18660): Terminated: ok {rc=0} 21:57:59.457858 --- ParallelTerminationStrategy: PID 18663 died... 21:57:59.477888 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18663): Terminated: ok {rc=0} 21:57:59.568361 bus /sierra_9: Setting Powered False 21:58:00.668332 bus /sierra_9: Setting Powered False 21:58:01.793943 bus /sierra_8: Setting Powered False 21:58:02.903249 bus /sierra_8: Setting Powered False 21:58:04.020313 bus /sierra_3: Setting Powered False 21:58:05.120683 bus /sierra_3: Setting Powered False 21:58:06.237663 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:oc2g --------------------------------------------------------------------- 21:58:07.493857 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:58:07.497863 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 21:58:07.517768 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 21:58:07.555722 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 21:58:07.640618 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 21:58:07.660736 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 21:58:07.698569 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 21:58:08.286817 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 21:58:08.336781 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:08.347270 tst gprs:oc2g: Using 1 x bts (candidates: 1) 21:58:08.382735 tst cs_paging_gprs_active.py: using LAC 17016 21:58:08.515701 tst cs_paging_gprs_active.py: using RAC 186 21:58:08.643556 tst cs_paging_gprs_active.py: using CellId 17016 21:58:08.764223 tst cs_paging_gprs_active.py: using BVCI 17017 21:58:08.876254 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:08.886700 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:08.896865 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:08.907126 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:08.917212 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:08.927216 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:08.937392 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:08.947490 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:08.957786 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:58:09.078106 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:58:09.197588 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:58:09.420844 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:58:09.752373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18669): Launched 21:58:10.039290 run iperf3-srv_10.42.42.10(pid=18670): Launched 21:58:10.163250 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:58:10.385977 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:58:10.716022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18671): Launched 21:58:11.002511 run iperf3-srv_10.42.42.10(pid=18672): Launched 21:58:11.127159 tst cs_paging_gprs_active.py:38: start network... 21:58:11.349927 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:58:11.861177 run create_hlr_db(pid=18673): Launched 21:58:11.996083 bus /sierra_2: Setting Powered False 21:58:13.062260 run create_hlr_db(pid=18673): Terminated: ok {rc=0} 21:58:13.501862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18675): Launched 21:58:13.810071 run osmo-hlr_10.42.42.2(pid=18676): Launched 21:58:13.925956 run osmo-stp_10.42.42.5: Starting osmo-stp 21:58:14.454646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18678): Launched 21:58:14.762026 run osmo-stp_10.42.42.5(pid=18679): Launched 21:58:14.877450 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:58:15.405461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18681): Launched 21:58:15.523272 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:58:15.784016 run patchelf(pid=18682): Launched 21:58:15.973473 run osmo-stp_10.42.42.5(pid=18679): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18679)] 21:58:16.106830 run osmo-stp_10.42.42.5(pid=18679): stdout: | (launched: 2022-12-08_21:58:14.705275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:16.242579 run osmo-stp_10.42.42.5(pid=18679): stderr: | 20221208215814878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215814878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215814878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215814879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215814879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215814879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215814879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:16.378703 run osmo-stp_10.42.42.5(pid=18679): stdout: | (launched: 2022-12-08_21:58:14.705275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:16.508789 run osmo-stp_10.42.42.5(pid=18679): stderr: | 20221208215814878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215814878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215814878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215814879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215814879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215814879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215814879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:16.662992 run patchelf(pid=18682): Terminating (SIGINT) 21:58:16.841897 run patchelf(pid=18682): Terminated: ok {rc=0} 21:58:16.971249 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18679): Process ended prematurely: osmo-stp_10.42.42.5(pid=18679) [trial-2350↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18679)] [trial-2350↪gprs:oc2g↪cs_paging_gprs_active.py:38] 21:58:16.981875 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 21:58:17.010836 run osmo-hlr_10.42.42.2(pid=18676): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18676)] 21:58:17.060708 run osmo-hlr_10.42.42.2(pid=18676): stdout: | (launched: 2022-12-08_21:58:13.753311) 21:58:17.112475 run osmo-hlr_10.42.42.2(pid=18676): stderr: | 20221208215813934 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215813934 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215813934 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215813934 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215813934 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215813934 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215813947 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215813958 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215813958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215813958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:58:17.164337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18669): Terminating (SIGTERM) 21:58:17.204378 run iperf3-srv_10.42.42.10(pid=18670): Terminating (SIGTERM) 21:58:17.244256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18671): Terminating (SIGTERM) 21:58:17.284035 run iperf3-srv_10.42.42.10(pid=18672): Terminating (SIGTERM) 21:58:17.323791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18675): Terminating (SIGTERM) 21:58:17.363800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18678): Terminating (SIGTERM) 21:58:17.403936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18681): Terminating (SIGTERM) 21:58:17.444360 --- ParallelTerminationStrategy: PID 18669 died... 21:58:17.463799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18669): Terminated: ok {rc=0} 21:58:17.508698 --- ParallelTerminationStrategy: PID 18670 died... 21:58:17.527623 run iperf3-srv_10.42.42.10(pid=18670): Terminated {rc=256} 21:58:17.572476 --- ParallelTerminationStrategy: PID 18671 died... 21:58:17.591392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18671): Terminated: ok {rc=0} 21:58:17.635871 --- ParallelTerminationStrategy: PID 18672 died... 21:58:17.654662 run iperf3-srv_10.42.42.10(pid=18672): Terminated {rc=256} 21:58:17.699134 --- ParallelTerminationStrategy: PID 18675 died... 21:58:17.717894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18675): Terminated: ok {rc=0} 21:58:17.762209 --- ParallelTerminationStrategy: PID 18678 died... 21:58:17.780776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18678): Terminated: ok {rc=0} 21:58:17.825579 --- ParallelTerminationStrategy: PID 18681 died... 21:58:17.844403 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18681): Terminated: ok {rc=0} 21:58:17.929313 bus /gobi_0: Setting Powered False 21:58:19.028109 bus /gobi_0: Setting Powered False 21:58:20.148711 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:oc2g iperf3.py ---------------------------------------------- 21:58:21.297354 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:21.308180 tst gprs:oc2g: Using 1 x bts (candidates: 1) 21:58:21.343628 tst iperf3.py: using LAC 17017 21:58:21.464210 tst iperf3.py: using RAC 187 21:58:21.585449 tst iperf3.py: using CellId 17017 21:58:21.714872 tst iperf3.py: using BVCI 17018 21:58:21.836775 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:21.847869 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:21.858864 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:21.870188 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:21.881413 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:21.892851 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:21.904202 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:21.915534 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:21.926967 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:58:22.044806 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:58:22.250512 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:58:22.558190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18683): Launched 21:58:22.825696 run iperf3-srv_10.42.42.10(pid=18684): Launched 21:58:22.940672 tst iperf3.py:8: start network... 21:58:23.145913 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:58:23.621762 run create_hlr_db(pid=18685): Launched 21:58:23.747748 bus /gobi_6: Setting Powered False 21:58:24.808412 run create_hlr_db(pid=18685): Terminated: ok {rc=0} 21:58:25.258165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18687): Launched 21:58:25.587937 run osmo-hlr_10.42.42.2(pid=18688): Launched 21:58:25.713043 run osmo-stp_10.42.42.5: Starting osmo-stp 21:58:26.283532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18690): Launched 21:58:26.612587 run osmo-stp_10.42.42.5(pid=18691): Launched 21:58:26.737752 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:58:27.307730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18693): Launched 21:58:27.434839 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:58:27.714307 run patchelf(pid=18694): Launched 21:58:27.897750 run osmo-stp_10.42.42.5(pid=18691): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18691)] 21:58:28.037309 run osmo-stp_10.42.42.5(pid=18691): stdout: | (launched: 2022-12-08_21:58:26.552312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:28.178452 run osmo-stp_10.42.42.5(pid=18691): stderr: | 20221208215826750 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215826750 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215826750 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215826750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215826751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215826751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215826751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:28.319852 run osmo-stp_10.42.42.5(pid=18691): stdout: | (launched: 2022-12-08_21:58:26.552312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:28.456158 run osmo-stp_10.42.42.5(pid=18691): stderr: | 20221208215826750 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215826750 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215826750 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215826750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215826751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215826751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215826751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:28.616654 run patchelf(pid=18694): Terminating (SIGINT) 21:58:28.801762 run patchelf(pid=18694): Terminated: ok {rc=0} 21:58:28.934941 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18691): Process ended prematurely: osmo-stp_10.42.42.5(pid=18691) [trial-2350↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18691)] [trial-2350↪gprs:oc2g↪iperf3.py:8] 21:58:28.945251 tst iperf3.py:8: Test FAILED (7.7 sec) 21:58:28.974540 run osmo-hlr_10.42.42.2(pid=18688): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18688)] 21:58:29.026221 run osmo-hlr_10.42.42.2(pid=18688): stdout: | (launched: 2022-12-08_21:58:25.527695) 21:58:29.079712 run osmo-hlr_10.42.42.2(pid=18688): stderr: | 20221208215825727 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215825727 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215825727 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215825727 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215825727 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215825727 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215825740 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215825748 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215825748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215825749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:58:29.133644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18683): Terminating (SIGTERM) 21:58:29.176590 run iperf3-srv_10.42.42.10(pid=18684): Terminating (SIGTERM) 21:58:29.219574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18687): Terminating (SIGTERM) 21:58:29.262671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18690): Terminating (SIGTERM) 21:58:29.305571 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18693): Terminating (SIGTERM) 21:58:29.349442 --- ParallelTerminationStrategy: PID 18683 died... 21:58:29.369882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18683): Terminated: ok {rc=0} 21:58:29.418147 --- ParallelTerminationStrategy: PID 18684 died... 21:58:29.438182 run iperf3-srv_10.42.42.10(pid=18684): Terminated {rc=256} 21:58:29.485874 --- ParallelTerminationStrategy: PID 18687 died... 21:58:29.506052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18687): Terminated: ok {rc=0} 21:58:29.553734 --- ParallelTerminationStrategy: PID 18690 died... 21:58:29.573693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18690): Terminated: ok {rc=0} 21:58:29.621342 --- ParallelTerminationStrategy: PID 18693 died... 21:58:29.641427 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18693): Terminated: ok {rc=0} 21:58:29.730127 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:oc2g iperf3m4.py ---------------------------------------------- 21:58:30.890227 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:30.902388 tst gprs:oc2g: Using 1 x bts (candidates: 1) 21:58:30.945165 tst iperf3m4.py: using LAC 17018 21:58:31.075667 tst iperf3m4.py: using RAC 188 21:58:31.206667 tst iperf3m4.py: using CellId 17018 21:58:31.330538 tst iperf3m4.py: using BVCI 17019 21:58:31.454730 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:31.466728 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:31.478677 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:31.491713 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:31.505682 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:31.517514 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:31.530040 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:31.542765 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:31.555601 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:58:31.678941 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:58:31.807375 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:58:31.961887 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:58:32.095485 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:58:32.346645 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:58:32.657701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18695): Launched 21:58:32.926910 run iperf3-srv_10.42.42.10(pid=18696): Launched 21:58:33.041938 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:58:33.247450 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:58:33.555904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18697): Launched 21:58:33.822579 run iperf3-srv_10.42.42.10(pid=18698): Launched 21:58:33.937549 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:58:34.142678 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:58:34.451572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18699): Launched 21:58:34.718226 run iperf3-srv_10.42.42.10(pid=18700): Launched 21:58:34.832941 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:58:35.037312 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:58:35.345934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18701): Launched 21:58:35.612519 run iperf3-srv_10.42.42.10(pid=18702): Launched 21:58:35.727407 tst iperf3m4.py:8: start network... 21:58:35.932346 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:58:36.409322 run create_hlr_db(pid=18703): Launched 21:58:36.534057 bus /gobi_6: Setting Powered False 21:58:37.595548 run create_hlr_db(pid=18703): Terminated: ok {rc=0} 21:58:38.045189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18705): Launched 21:58:38.374749 run osmo-hlr_10.42.42.2(pid=18706): Launched 21:58:38.500679 run osmo-stp_10.42.42.5: Starting osmo-stp 21:58:39.071060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18708): Launched 21:58:39.400692 run osmo-stp_10.42.42.5(pid=18709): Launched 21:58:39.526428 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:58:40.095856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18711): Launched 21:58:40.222263 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:58:40.501211 run patchelf(pid=18712): Launched 21:58:40.684018 run osmo-stp_10.42.42.5(pid=18709): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18709)] 21:58:40.823686 run osmo-stp_10.42.42.5(pid=18709): stdout: | (launched: 2022-12-08_21:58:39.339938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:40.964428 run osmo-stp_10.42.42.5(pid=18709): stderr: | 20221208215839533 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215839533 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215839533 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215839533 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215839536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215839536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215839536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:41.106183 run osmo-stp_10.42.42.5(pid=18709): stdout: | (launched: 2022-12-08_21:58:39.339938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:41.241563 run osmo-stp_10.42.42.5(pid=18709): stderr: | 20221208215839533 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215839533 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215839533 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215839533 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215839536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215839536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215839536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:41.403334 run patchelf(pid=18712): Terminating (SIGINT) 21:58:41.588243 run patchelf(pid=18712): Terminated: ok {rc=0} 21:58:41.720846 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18709): Process ended prematurely: osmo-stp_10.42.42.5(pid=18709) [trial-2350↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18709)] [trial-2350↪gprs:oc2g↪iperf3m4.py:8] 21:58:41.731039 tst iperf3m4.py:8: Test FAILED (10.9 sec) 21:58:41.760573 run osmo-hlr_10.42.42.2(pid=18706): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18706)] 21:58:41.812218 run osmo-hlr_10.42.42.2(pid=18706): stdout: | (launched: 2022-12-08_21:58:38.314293) 21:58:41.865270 run osmo-hlr_10.42.42.2(pid=18706): stderr: | 20221208215838513 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215838513 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215838513 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215838513 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215838513 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215838513 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215838526 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215838534 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215838534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215838534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:58:41.918572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18695): Terminating (SIGTERM) 21:58:41.961308 run iperf3-srv_10.42.42.10(pid=18696): Terminating (SIGTERM) 21:58:42.004052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18697): Terminating (SIGTERM) 21:58:42.046946 run iperf3-srv_10.42.42.10(pid=18698): Terminating (SIGTERM) 21:58:42.089685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18699): Terminating (SIGTERM) 21:58:42.132482 run iperf3-srv_10.42.42.10(pid=18700): Terminating (SIGTERM) 21:58:42.175195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18701): Terminating (SIGTERM) 21:58:42.217870 run iperf3-srv_10.42.42.10(pid=18702): Terminating (SIGTERM) 21:58:42.260436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18705): Terminating (SIGTERM) 21:58:42.303203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18708): Terminating (SIGTERM) 21:58:42.346262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18711): Terminating (SIGTERM) 21:58:42.389282 --- ParallelTerminationStrategy: PID 18695 died... 21:58:42.409750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18695): Terminated: ok {rc=0} 21:58:42.457553 --- ParallelTerminationStrategy: PID 18696 died... 21:58:42.477408 run iperf3-srv_10.42.42.10(pid=18696): Terminated {rc=256} 21:58:42.524926 --- ParallelTerminationStrategy: PID 18697 died... 21:58:42.544810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18697): Terminated: ok {rc=0} 21:58:42.592305 --- ParallelTerminationStrategy: PID 18698 died... 21:58:42.612231 run iperf3-srv_10.42.42.10(pid=18698): Terminated {rc=256} 21:58:42.659518 --- ParallelTerminationStrategy: PID 18699 died... 21:58:42.679429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18699): Terminated: ok {rc=0} 21:58:42.726885 --- ParallelTerminationStrategy: PID 18700 died... 21:58:42.746847 run iperf3-srv_10.42.42.10(pid=18700): Terminated {rc=256} 21:58:42.794467 --- ParallelTerminationStrategy: PID 18701 died... 21:58:42.814330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18701): Terminated: ok {rc=0} 21:58:42.861949 --- ParallelTerminationStrategy: PID 18702 died... 21:58:42.881875 run iperf3-srv_10.42.42.10(pid=18702): Terminated {rc=256} 21:58:42.929360 --- ParallelTerminationStrategy: PID 18705 died... 21:58:42.949381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18705): Terminated: ok {rc=0} 21:58:42.996922 --- ParallelTerminationStrategy: PID 18708 died... 21:58:43.017006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18708): Terminated: ok {rc=0} 21:58:43.064654 --- ParallelTerminationStrategy: PID 18711 died... 21:58:43.084637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18711): Terminated: ok {rc=0} 21:58:43.173900 bus /gobi_4: Setting Powered False 21:58:44.274791 bus /gobi_4: Setting Powered False 21:58:45.393388 bus /gobi_1: Setting Powered False 21:58:46.490876 bus /gobi_1: Setting Powered False 21:58:47.607093 bus /gobi_0: Setting Powered False 21:58:48.706282 bus /gobi_0: Setting Powered False 21:58:49.825223 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:oc2g ping.py ---------------------------------------------- 21:58:50.931897 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:50.943218 tst gprs:oc2g: Using 1 x bts (candidates: 1) 21:58:50.980478 tst ping.py: using LAC 17019 21:58:51.109136 tst ping.py: using RAC 189 21:58:51.235665 tst ping.py: using CellId 17019 21:58:51.362722 tst ping.py: using BVCI 17020 21:58:51.482572 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:51.493604 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:51.504306 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:51.515343 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:51.526345 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:51.537326 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:51.548265 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:51.559341 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:58:51.672858 tst ping.py:19: start network... 21:58:51.876176 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:58:52.344329 run create_hlr_db(pid=18713): Launched 21:58:52.461258 bus /gobi_6: Setting Powered False 21:58:53.521810 run create_hlr_db(pid=18713): Terminated: ok {rc=0} 21:58:53.963645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18715): Launched 21:58:54.288293 run osmo-hlr_10.42.42.2(pid=18716): Launched 21:58:54.412410 run osmo-stp_10.42.42.5: Starting osmo-stp 21:58:54.974003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18718): Launched 21:58:55.298346 run osmo-stp_10.42.42.5(pid=18719): Launched 21:58:55.421471 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:58:55.979557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18721): Launched 21:58:56.103483 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:58:56.378150 run patchelf(pid=18722): Launched 21:58:56.559075 run osmo-stp_10.42.42.5(pid=18719): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18719)] 21:58:56.697199 run osmo-stp_10.42.42.5(pid=18719): stdout: | (launched: 2022-12-08_21:58:55.239048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:56.836432 run osmo-stp_10.42.42.5(pid=18719): stderr: | 20221208215855433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215855434 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215855434 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215855434 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215855435 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215855435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215855435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:56.975832 run osmo-stp_10.42.42.5(pid=18719): stdout: | (launched: 2022-12-08_21:58:55.239048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:57.109642 run osmo-stp_10.42.42.5(pid=18719): stderr: | 20221208215855433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215855434 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215855434 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215855434 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215855435 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215855435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215855435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:57.267786 run patchelf(pid=18722): Terminating (SIGINT) 21:58:57.450852 run patchelf(pid=18722): Terminated: ok {rc=0} 21:58:57.581994 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18719): Process ended prematurely: osmo-stp_10.42.42.5(pid=18719) [trial-2350↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18719)] [trial-2350↪gprs:oc2g↪ping.py:22] 21:58:57.591413 tst ping.py:22: Test FAILED (6.7 sec) 21:58:57.620248 run osmo-hlr_10.42.42.2(pid=18716): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18716)] 21:58:57.671760 run osmo-hlr_10.42.42.2(pid=18716): stdout: | (launched: 2022-12-08_21:58:54.228427) 21:58:57.725221 run osmo-hlr_10.42.42.2(pid=18716): stderr: | 20221208215854426 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215854426 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215854426 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215854426 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215854426 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215854426 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215854438 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215854446 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215854446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215854446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:58:57.778657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18715): Terminating (SIGTERM) 21:58:57.821581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18718): Terminating (SIGTERM) 21:58:57.864414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18721): Terminating (SIGTERM) 21:58:57.907541 --- ParallelTerminationStrategy: PID 18715 died... 21:58:57.928131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18715): Terminated: ok {rc=0} 21:58:57.975692 --- ParallelTerminationStrategy: PID 18718 died... 21:58:57.995834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18718): Terminated: ok {rc=0} 21:58:58.043377 --- ParallelTerminationStrategy: PID 18721 died... 21:58:58.063435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18721): Terminated: ok {rc=0} 21:58:58.152040 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 21:58:59.241152 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:59.252428 tst gprs:oc2g: Using 1 x bts (candidates: 1) 21:58:59.292342 tst ping_idle_ping.py: using LAC 17020 21:58:59.412150 tst ping_idle_ping.py: using RAC 190 21:58:59.536447 tst ping_idle_ping.py: using CellId 17020 21:58:59.655762 tst ping_idle_ping.py: using BVCI 17021 21:58:59.768568 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:59.779273 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:59.789959 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:59.800829 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:59.811675 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:59.822675 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:59.833877 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:59.844698 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:58:59.958563 tst ping_idle_ping.py:24: start network... 21:59:00.160937 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:59:00.631458 run create_hlr_db(pid=18723): Launched 21:59:00.746852 bus /gobi_6: Setting Powered False 21:59:01.810900 run create_hlr_db(pid=18723): Terminated: ok {rc=0} 21:59:02.281796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18725): Launched 21:59:02.608200 run osmo-hlr_10.42.42.2(pid=18726): Launched 21:59:02.731655 run osmo-stp_10.42.42.5: Starting osmo-stp 21:59:03.290751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18728): Launched 21:59:03.616403 run osmo-stp_10.42.42.5(pid=18729): Launched 21:59:03.739490 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:59:04.300720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18731): Launched 21:59:04.425187 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:59:04.699739 run patchelf(pid=18732): Launched 21:59:04.880738 run osmo-stp_10.42.42.5(pid=18729): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18729)] 21:59:05.019021 run osmo-stp_10.42.42.5(pid=18729): stdout: | (launched: 2022-12-08_21:59:03.556823) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:05.158591 run osmo-stp_10.42.42.5(pid=18729): stderr: | 20221208215903751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215903751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215903751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215903752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215903752 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215903752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215903752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:05.298586 run osmo-stp_10.42.42.5(pid=18729): stdout: | (launched: 2022-12-08_21:59:03.556823) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:05.432447 run osmo-stp_10.42.42.5(pid=18729): stderr: | 20221208215903751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215903751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215903751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215903752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215903752 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215903752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215903752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:05.591002 run patchelf(pid=18732): Terminating (SIGINT) 21:59:05.773589 run patchelf(pid=18732): Terminated: ok {rc=0} 21:59:05.905343 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18729): Process ended prematurely: osmo-stp_10.42.42.5(pid=18729) [trial-2350↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18729)] [trial-2350↪gprs:oc2g↪ping_idle_ping.py:27] 21:59:05.914978 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 21:59:05.943599 run osmo-hlr_10.42.42.2(pid=18726): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18726)] 21:59:05.994179 run osmo-hlr_10.42.42.2(pid=18726): stdout: | (launched: 2022-12-08_21:59:02.548670) 21:59:06.046940 run osmo-hlr_10.42.42.2(pid=18726): stderr: | 20221208215902748 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215902748 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215902748 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215902748 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215902748 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215902748 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215902765 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215902773 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215902774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215902774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:59:06.100146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18725): Terminating (SIGTERM) 21:59:06.142786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18728): Terminating (SIGTERM) 21:59:06.185880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18731): Terminating (SIGTERM) 21:59:06.229266 --- ParallelTerminationStrategy: PID 18725 died... 21:59:06.249888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18725): Terminated: ok {rc=0} 21:59:06.297796 --- ParallelTerminationStrategy: PID 18728 died... 21:59:06.318065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18728): Terminated: ok {rc=0} 21:59:06.365921 --- ParallelTerminationStrategy: PID 18731 died... 21:59:06.386285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18731): Terminated: ok {rc=0} 21:59:06.474950 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 21:59:07.764015 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:59:07.769641 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 21:59:07.790555 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 21:59:07.829132 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 21:59:07.914551 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 21:59:07.934492 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 21:59:07.972250 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 21:59:08.561798 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 21:59:08.610559 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:08.621026 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:59:08.657393 tst cs_paging_gprs_active.py: using LAC 17021 21:59:08.776940 tst cs_paging_gprs_active.py: using RAC 191 21:59:08.896645 tst cs_paging_gprs_active.py: using CellId 17021 21:59:09.017393 tst cs_paging_gprs_active.py: using BVCI 17022 21:59:09.127006 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:09.137736 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:09.148211 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:09.158906 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:09.169558 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:09.180026 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:09.190803 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:09.201486 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:09.212259 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:59:09.329857 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:59:09.445082 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:59:09.648643 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:59:09.952561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18737): Launched 21:59:10.216785 run iperf3-srv_10.42.42.10(pid=18738): Launched 21:59:10.330814 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:59:10.533167 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:59:10.837692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18739): Launched 21:59:11.102425 run iperf3-srv_10.42.42.10(pid=18740): Launched 21:59:11.216428 tst cs_paging_gprs_active.py:38: start network... 21:59:11.418975 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:59:11.916329 run create_hlr_db(pid=18741): Launched 21:59:12.049465 bus /gobi_6: Setting Powered False 21:59:13.113516 run create_hlr_db(pid=18741): Terminated: ok {rc=0} 21:59:13.564543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18743): Launched 21:59:13.887071 run osmo-hlr_10.42.42.2(pid=18744): Launched 21:59:14.010118 run osmo-stp_10.42.42.5: Starting osmo-stp 21:59:14.565605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18746): Launched 21:59:14.890004 run osmo-stp_10.42.42.5(pid=18747): Launched 21:59:15.015583 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:59:15.572786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18749): Launched 21:59:15.696406 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:59:15.977889 run patchelf(pid=18750): Launched 21:59:16.171849 run osmo-stp_10.42.42.5(pid=18747): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18747)] 21:59:16.311722 run osmo-stp_10.42.42.5(pid=18747): stdout: | (launched: 2022-12-08_21:59:14.830622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:16.455540 run osmo-stp_10.42.42.5(pid=18747): stderr: | 20221208215915022 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215915022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215915022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215915023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215915023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215915023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215915023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:16.596394 run osmo-stp_10.42.42.5(pid=18747): stdout: | (launched: 2022-12-08_21:59:14.830622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:16.731913 run osmo-stp_10.42.42.5(pid=18747): stderr: | 20221208215915022 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215915022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215915022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215915023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215915023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215915023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215915023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:16.892247 run patchelf(pid=18750): Terminating (SIGINT) 21:59:17.075838 run patchelf(pid=18750): Terminated: ok {rc=0} 21:59:17.207983 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18747): Process ended prematurely: osmo-stp_10.42.42.5(pid=18747) [trial-2350↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18747)] [trial-2350↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 21:59:17.218479 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 21:59:17.247412 run osmo-hlr_10.42.42.2(pid=18744): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18744)] 21:59:17.298866 run osmo-hlr_10.42.42.2(pid=18744): stdout: | (launched: 2022-12-08_21:59:13.828126) 21:59:17.352007 run osmo-hlr_10.42.42.2(pid=18744): stderr: | 20221208215914024 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215914024 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215914024 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215914024 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215914024 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215914024 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215914036 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215914044 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215914045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215914045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:59:17.405761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18737): Terminating (SIGTERM) 21:59:17.448754 run iperf3-srv_10.42.42.10(pid=18738): Terminating (SIGTERM) 21:59:17.491464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18739): Terminating (SIGTERM) 21:59:17.534170 run iperf3-srv_10.42.42.10(pid=18740): Terminating (SIGTERM) 21:59:17.576765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18743): Terminating (SIGTERM) 21:59:17.620298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18746): Terminating (SIGTERM) 21:59:17.663304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18749): Terminating (SIGTERM) 21:59:17.706396 --- ParallelTerminationStrategy: PID 18737 died... 21:59:17.726858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18737): Terminated: ok {rc=0} 21:59:17.774296 --- ParallelTerminationStrategy: PID 18738 died... 21:59:17.794189 run iperf3-srv_10.42.42.10(pid=18738): Terminated {rc=256} 21:59:17.841217 --- ParallelTerminationStrategy: PID 18739 died... 21:59:17.861163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18739): Terminated: ok {rc=0} 21:59:17.908118 --- ParallelTerminationStrategy: PID 18740 died... 21:59:17.927915 run iperf3-srv_10.42.42.10(pid=18740): Terminated {rc=256} 21:59:17.975101 --- ParallelTerminationStrategy: PID 18743 died... 21:59:17.995028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18743): Terminated: ok {rc=0} 21:59:18.042272 --- ParallelTerminationStrategy: PID 18746 died... 21:59:18.062140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18746): Terminated: ok {rc=0} 21:59:18.109430 --- ParallelTerminationStrategy: PID 18749 died... 21:59:18.129471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18749): Terminated: ok {rc=0} 21:59:18.218798 bus /gobi_0: Setting Powered False 21:59:19.320650 bus /gobi_0: Setting Powered False 21:59:20.437848 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 21:59:21.589392 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:21.601277 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:59:21.641051 tst iperf3.py: using LAC 17022 21:59:21.769966 tst iperf3.py: using RAC 192 21:59:21.898041 tst iperf3.py: using CellId 17022 21:59:22.024785 tst iperf3.py: using BVCI 17023 21:59:22.143860 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:22.154948 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:22.166141 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:22.177641 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:22.188425 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:22.199890 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:22.211354 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:22.222694 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:22.234452 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:59:22.351154 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:59:22.554397 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:59:22.858962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18752): Launched 21:59:23.122171 run iperf3-srv_10.42.42.10(pid=18753): Launched 21:59:23.234955 tst iperf3.py:8: start network... 21:59:23.436567 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:59:23.905209 run create_hlr_db(pid=18754): Launched 21:59:24.021366 bus /gobi_6: Setting Powered False 21:59:25.081857 run create_hlr_db(pid=18754): Terminated: ok {rc=0} 21:59:25.503098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18756): Launched 21:59:25.805399 run osmo-hlr_10.42.42.2(pid=18757): Launched 21:59:25.920835 run osmo-stp_10.42.42.5: Starting osmo-stp 21:59:26.452844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18759): Launched 21:59:26.755949 run osmo-stp_10.42.42.5(pid=18760): Launched 21:59:26.871420 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:59:27.391326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18762): Launched 21:59:27.506739 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:59:27.762521 run patchelf(pid=18763): Launched 21:59:27.930589 run osmo-stp_10.42.42.5(pid=18760): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18760)] 21:59:28.059112 run osmo-stp_10.42.42.5(pid=18760): stdout: | (launched: 2022-12-08_21:59:26.700166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:28.188902 run osmo-stp_10.42.42.5(pid=18760): stderr: | 20221208215926872 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215926872 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215926872 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215926873 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215926873 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215926873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215926873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:28.319237 run osmo-stp_10.42.42.5(pid=18760): stdout: | (launched: 2022-12-08_21:59:26.700166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:28.443918 run osmo-stp_10.42.42.5(pid=18760): stderr: | 20221208215926872 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215926872 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215926872 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215926873 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215926873 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215926873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215926873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:28.591658 run patchelf(pid=18763): Terminating (SIGINT) 21:59:28.761991 run patchelf(pid=18763): Terminated: ok {rc=0} 21:59:28.884557 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18760): Process ended prematurely: osmo-stp_10.42.42.5(pid=18760) [trial-2350↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18760)] [trial-2350↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 21:59:28.894284 tst iperf3.py:8: Test FAILED (7.3 sec) 21:59:28.922125 run osmo-hlr_10.42.42.2(pid=18757): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18757)] 21:59:28.971012 run osmo-hlr_10.42.42.2(pid=18757): stdout: | (launched: 2022-12-08_21:59:25.749688) 21:59:29.021546 run osmo-hlr_10.42.42.2(pid=18757): stderr: | 20221208215925925 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215925925 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215925925 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215925925 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215925925 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215925925 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215925938 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215925946 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215925946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215925946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:59:29.072419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18752): Terminating (SIGTERM) 21:59:29.113407 run iperf3-srv_10.42.42.10(pid=18753): Terminating (SIGTERM) 21:59:29.154336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18756): Terminating (SIGTERM) 21:59:29.195265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18759): Terminating (SIGTERM) 21:59:29.236177 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18762): Terminating (SIGTERM) 21:59:29.277334 --- ParallelTerminationStrategy: PID 18752 died... 21:59:29.296597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18752): Terminated: ok {rc=0} 21:59:29.342200 --- ParallelTerminationStrategy: PID 18753 died... 21:59:29.361108 run iperf3-srv_10.42.42.10(pid=18753): Terminated {rc=256} 21:59:29.406625 --- ParallelTerminationStrategy: PID 18756 died... 21:59:29.425595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18756): Terminated: ok {rc=0} 21:59:29.470968 --- ParallelTerminationStrategy: PID 18759 died... 21:59:29.489893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18759): Terminated: ok {rc=0} 21:59:29.535642 --- ParallelTerminationStrategy: PID 18762 died... 21:59:29.554789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18762): Terminated: ok {rc=0} 21:59:29.642567 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 21:59:30.791387 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:30.802621 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:59:30.849311 tst iperf3m4.py: using LAC 17023 21:59:30.995139 tst iperf3m4.py: using RAC 193 21:59:31.158566 tst iperf3m4.py: using CellId 17023 21:59:31.285424 tst iperf3m4.py: using BVCI 17024 21:59:31.405519 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:31.417605 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:31.429279 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:31.440708 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:31.453302 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:31.464623 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:31.476298 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:31.487761 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:31.499431 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:59:31.644316 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:59:31.779757 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:59:31.917928 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:59:32.043794 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:59:32.267073 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:59:32.593944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18764): Launched 21:59:32.874002 run iperf3-srv_10.42.42.10(pid=18765): Launched 21:59:32.994255 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:59:33.210338 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:59:33.534129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18766): Launched 21:59:33.813314 run iperf3-srv_10.42.42.10(pid=18767): Launched 21:59:33.933407 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:59:34.148571 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:59:34.471334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18768): Launched 21:59:34.750695 run iperf3-srv_10.42.42.10(pid=18769): Launched 21:59:34.870583 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:59:35.085881 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:59:35.408891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18770): Launched 21:59:35.688814 run iperf3-srv_10.42.42.10(pid=18771): Launched 21:59:35.809230 tst iperf3m4.py:8: start network... 21:59:36.024735 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:59:36.524422 run create_hlr_db(pid=18772): Launched 21:59:36.655940 bus /gobi_6: Setting Powered False 21:59:37.720489 run create_hlr_db(pid=18772): Terminated: ok {rc=0} 21:59:38.153112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18774): Launched 21:59:38.457692 run osmo-hlr_10.42.42.2(pid=18775): Launched 21:59:38.573368 run osmo-stp_10.42.42.5: Starting osmo-stp 21:59:39.110795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18777): Launched 21:59:39.413096 run osmo-stp_10.42.42.5(pid=18778): Launched 21:59:39.528632 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:59:40.052906 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18780): Launched 21:59:40.170322 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:59:40.427693 run patchelf(pid=18781): Launched 21:59:40.596625 run osmo-stp_10.42.42.5(pid=18778): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18778)] 21:59:40.725502 run osmo-stp_10.42.42.5(pid=18778): stdout: | (launched: 2022-12-08_21:59:39.357373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:40.855636 run osmo-stp_10.42.42.5(pid=18778): stderr: | 20221208215939528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215939529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215939529 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215939529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215939531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215939532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215939532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:40.986409 run osmo-stp_10.42.42.5(pid=18778): stdout: | (launched: 2022-12-08_21:59:39.357373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:41.112495 run osmo-stp_10.42.42.5(pid=18778): stderr: | 20221208215939528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215939529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215939529 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215939529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215939531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215939532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215939532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:41.260758 run patchelf(pid=18781): Terminating (SIGINT) 21:59:41.431201 run patchelf(pid=18781): Terminated: ok {rc=0} 21:59:41.553739 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18778): Process ended prematurely: osmo-stp_10.42.42.5(pid=18778) [trial-2350↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18778)] [trial-2350↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 21:59:41.563207 tst iperf3m4.py:8: Test FAILED (10.8 sec) 21:59:41.591563 run osmo-hlr_10.42.42.2(pid=18775): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18775)] 21:59:41.640739 run osmo-hlr_10.42.42.2(pid=18775): stdout: | (launched: 2022-12-08_21:59:38.401101) 21:59:41.691754 run osmo-hlr_10.42.42.2(pid=18775): stderr: | 20221208215938577 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215938577 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215938577 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215938577 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215938577 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215938577 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215938589 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215938598 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215938598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215938598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:59:41.743231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18764): Terminating (SIGTERM) 21:59:41.784701 run iperf3-srv_10.42.42.10(pid=18765): Terminating (SIGTERM) 21:59:41.825986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18766): Terminating (SIGTERM) 21:59:41.867269 run iperf3-srv_10.42.42.10(pid=18767): Terminating (SIGTERM) 21:59:41.908755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18768): Terminating (SIGTERM) 21:59:41.950708 run iperf3-srv_10.42.42.10(pid=18769): Terminating (SIGTERM) 21:59:41.991724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18770): Terminating (SIGTERM) 21:59:42.032825 run iperf3-srv_10.42.42.10(pid=18771): Terminating (SIGTERM) 21:59:42.074019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18774): Terminating (SIGTERM) 21:59:42.115219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18777): Terminating (SIGTERM) 21:59:42.156996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18780): Terminating (SIGTERM) 21:59:42.198679 --- ParallelTerminationStrategy: PID 18764 died... 21:59:42.218024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18764): Terminated: ok {rc=0} 21:59:42.264185 --- ParallelTerminationStrategy: PID 18765 died... 21:59:42.283168 run iperf3-srv_10.42.42.10(pid=18765): Terminated {rc=256} 21:59:42.328842 --- ParallelTerminationStrategy: PID 18766 died... 21:59:42.348398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18766): Terminated: ok {rc=0} 21:59:42.394730 --- ParallelTerminationStrategy: PID 18767 died... 21:59:42.413716 run iperf3-srv_10.42.42.10(pid=18767): Terminated {rc=256} 21:59:42.459162 --- ParallelTerminationStrategy: PID 18768 died... 21:59:42.478046 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18768): Terminated: ok {rc=0} 21:59:42.523600 --- ParallelTerminationStrategy: PID 18769 died... 21:59:42.542547 run iperf3-srv_10.42.42.10(pid=18769): Terminated {rc=256} 21:59:42.588160 --- ParallelTerminationStrategy: PID 18770 died... 21:59:42.606941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18770): Terminated: ok {rc=0} 21:59:42.652553 --- ParallelTerminationStrategy: PID 18771 died... 21:59:42.671595 run iperf3-srv_10.42.42.10(pid=18771): Terminated {rc=256} 21:59:42.716719 --- ParallelTerminationStrategy: PID 18774 died... 21:59:42.735596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18774): Terminated: ok {rc=0} 21:59:42.780525 --- ParallelTerminationStrategy: PID 18777 died... 21:59:42.799433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18777): Terminated: ok {rc=0} 21:59:42.845063 --- ParallelTerminationStrategy: PID 18780 died... 21:59:42.864034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18780): Terminated: ok {rc=0} 21:59:42.951088 bus /gobi_4: Setting Powered False 21:59:44.055454 bus /gobi_4: Setting Powered False 21:59:45.172452 bus /gobi_1: Setting Powered False 21:59:46.281172 bus /gobi_1: Setting Powered False 21:59:47.395994 bus /gobi_0: Setting Powered False 21:59:48.495353 bus /gobi_0: Setting Powered False 21:59:49.616060 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 21:59:50.721619 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:50.732601 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:59:50.769313 tst ping.py: using LAC 17024 21:59:50.886241 tst ping.py: using RAC 194 21:59:51.004407 tst ping.py: using CellId 17024 21:59:51.121471 tst ping.py: using BVCI 17025 21:59:51.227971 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:51.238700 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:51.249257 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:51.259911 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:51.270531 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:51.281216 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:51.291943 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:51.302735 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:59:51.419165 tst ping.py:19: start network... 21:59:51.630222 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:59:52.115626 run create_hlr_db(pid=18782): Launched 21:59:52.242828 bus /gobi_6: Setting Powered False 21:59:53.304913 run create_hlr_db(pid=18782): Terminated: ok {rc=0} 21:59:53.743851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18784): Launched 21:59:54.058612 run osmo-hlr_10.42.42.2(pid=18785): Launched 21:59:54.177239 run osmo-stp_10.42.42.5: Starting osmo-stp 21:59:54.724886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18787): Launched 21:59:55.038532 run osmo-stp_10.42.42.5(pid=18788): Launched 21:59:55.156701 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:59:55.709400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18790): Launched 21:59:55.829822 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:59:56.097201 run patchelf(pid=18791): Launched 21:59:56.271967 run osmo-stp_10.42.42.5(pid=18788): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18788)] 21:59:56.406752 run osmo-stp_10.42.42.5(pid=18788): stdout: | (launched: 2022-12-08_21:59:54.981680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:56.542471 run osmo-stp_10.42.42.5(pid=18788): stderr: | 20221208215955171 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215955171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215955172 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215955172 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215955173 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215955173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215955173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:56.678401 run osmo-stp_10.42.42.5(pid=18788): stdout: | (launched: 2022-12-08_21:59:54.981680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:56.808211 run osmo-stp_10.42.42.5(pid=18788): stderr: | 20221208215955171 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208215955171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208215955172 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208215955172 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208215955173 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208215955173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208215955173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:56.962113 run patchelf(pid=18791): Terminating (SIGINT) 21:59:57.139870 run patchelf(pid=18791): Terminated: ok {rc=0} 21:59:57.268068 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18788): Process ended prematurely: osmo-stp_10.42.42.5(pid=18788) [trial-2350↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18788)] [trial-2350↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 21:59:57.277595 tst ping.py:22: Test FAILED (6.5 sec) 21:59:57.306099 run osmo-hlr_10.42.42.2(pid=18785): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18785)] 21:59:57.357259 run osmo-hlr_10.42.42.2(pid=18785): stdout: | (launched: 2022-12-08_21:59:54.000898) 21:59:57.410242 run osmo-hlr_10.42.42.2(pid=18785): stderr: | 20221208215954199 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208215954199 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208215954199 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208215954199 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208215954199 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208215954199 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208215954212 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208215954220 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208215954220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208215954220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:59:57.463338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18784): Terminating (SIGTERM) 21:59:57.506002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18787): Terminating (SIGTERM) 21:59:57.548482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18790): Terminating (SIGTERM) 21:59:57.591176 --- ParallelTerminationStrategy: PID 18784 died... 21:59:57.611414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18784): Terminated: ok {rc=0} 21:59:57.658562 --- ParallelTerminationStrategy: PID 18787 died... 21:59:57.678534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18787): Terminated: ok {rc=0} 21:59:57.725601 --- ParallelTerminationStrategy: PID 18790 died... 21:59:57.745509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18790): Terminated: ok {rc=0} 21:59:57.833858 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 21:59:58.921988 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:58.933658 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:59:58.973334 tst ping_idle_ping.py: using LAC 17025 21:59:59.091011 tst ping_idle_ping.py: using RAC 195 21:59:59.210232 tst ping_idle_ping.py: using CellId 17025 21:59:59.329154 tst ping_idle_ping.py: using BVCI 17026 21:59:59.439361 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:59.450654 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:59.461486 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:59.472910 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:59.484346 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:59.495676 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:59.507108 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:59.518501 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:59:59.632292 tst ping_idle_ping.py:24: start network... 21:59:59.829136 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:00:00.288431 run create_hlr_db(pid=18792): Launched 22:00:00.401088 bus /gobi_6: Setting Powered False 22:00:01.466079 run create_hlr_db(pid=18792): Terminated: ok {rc=0} 22:00:01.942460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18797): Launched 22:00:02.313513 run osmo-hlr_10.42.42.2(pid=18798): Launched 22:00:02.428415 run osmo-stp_10.42.42.5: Starting osmo-stp 22:00:02.951622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18800): Launched 22:00:03.247779 run osmo-stp_10.42.42.5(pid=18801): Launched 22:00:03.361207 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:00:03.871507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18803): Launched 22:00:03.985704 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:00:04.236592 run patchelf(pid=18804): Launched 22:00:04.402033 run osmo-stp_10.42.42.5(pid=18801): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18801)] 22:00:04.528689 run osmo-stp_10.42.42.5(pid=18801): stdout: | (launched: 2022-12-08_22:00:03.193843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:04.656506 run osmo-stp_10.42.42.5(pid=18801): stderr: | 20221208220003364 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220003364 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220003364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220003365 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220003365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220003365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220003365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:04.784573 run osmo-stp_10.42.42.5(pid=18801): stdout: | (launched: 2022-12-08_22:00:03.193843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:04.907009 run osmo-stp_10.42.42.5(pid=18801): stderr: | 20221208220003364 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220003364 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220003364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220003365 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220003365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220003365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220003365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:05.051806 run patchelf(pid=18804): Terminating (SIGINT) 22:00:05.219272 run patchelf(pid=18804): Terminated: ok {rc=0} 22:00:05.340135 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18801): Process ended prematurely: osmo-stp_10.42.42.5(pid=18801) [trial-2350↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18801)] [trial-2350↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 22:00:05.349117 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:00:05.376303 run osmo-hlr_10.42.42.2(pid=18798): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18798)] 22:00:05.425768 run osmo-hlr_10.42.42.2(pid=18798): stdout: | (launched: 2022-12-08_22:00:02.259944) 22:00:05.476610 run osmo-hlr_10.42.42.2(pid=18798): stderr: | 20221208220002432 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220002432 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220002432 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220002432 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220002432 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220002432 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220002444 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220002456 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220002456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220002456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:00:05.527997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18797): Terminating (SIGTERM) 22:00:05.568813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18800): Terminating (SIGTERM) 22:00:05.609744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18803): Terminating (SIGTERM) 22:00:05.650760 --- ParallelTerminationStrategy: PID 18797 died... 22:00:05.670133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18797): Terminated: ok {rc=0} 22:00:05.716071 --- ParallelTerminationStrategy: PID 18800 died... 22:00:05.734900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18800): Terminated: ok {rc=0} 22:00:05.780536 --- ParallelTerminationStrategy: PID 18803 died... 22:00:05.799614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18803): Terminated: ok {rc=0} 22:00:05.887566 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:00:07.180698 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:00:07.187049 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:00:07.208034 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:00:07.246479 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:00:07.337170 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:00:07.357949 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:00:07.395990 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:00:07.980357 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:00:08.029929 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:08.040654 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:00:08.094644 tst cs_paging_gprs_active.py: using LAC 17026 22:00:08.213568 tst cs_paging_gprs_active.py: using RAC 196 22:00:08.338740 tst cs_paging_gprs_active.py: using CellId 17026 22:00:08.463035 tst cs_paging_gprs_active.py: using BVCI 17027 22:00:08.581495 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:08.592876 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:08.604016 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:08.615115 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:08.625980 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:08.636869 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:08.647970 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:08.658846 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:08.669934 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:00:08.784031 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:00:08.899061 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:00:09.102467 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:00:09.405589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18808): Launched 22:00:09.669458 run iperf3-srv_10.42.42.10(pid=18809): Launched 22:00:09.783670 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:00:09.986661 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:00:10.291074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18810): Launched 22:00:10.553521 run iperf3-srv_10.42.42.10(pid=18811): Launched 22:00:10.667725 tst cs_paging_gprs_active.py:38: start network... 22:00:10.871382 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:00:11.341213 run create_hlr_db(pid=18812): Launched 22:00:11.457454 bus /gobi_6: Setting Powered False 22:00:12.521089 run create_hlr_db(pid=18812): Terminated: ok {rc=0} 22:00:12.969084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18814): Launched 22:00:13.290768 run osmo-hlr_10.42.42.2(pid=18815): Launched 22:00:13.414843 run osmo-stp_10.42.42.5: Starting osmo-stp 22:00:13.967576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18817): Launched 22:00:14.289572 run osmo-stp_10.42.42.5(pid=18818): Launched 22:00:14.413523 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:00:14.969418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18820): Launched 22:00:15.092133 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:00:15.364669 run patchelf(pid=18821): Launched 22:00:15.543434 run osmo-stp_10.42.42.5(pid=18818): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18818)] 22:00:15.680131 run osmo-stp_10.42.42.5(pid=18818): stdout: | (launched: 2022-12-08_22:00:14.231878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:15.818387 run osmo-stp_10.42.42.5(pid=18818): stderr: | 20221208220014422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220014422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220014422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220014422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220014423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220014423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220014423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:15.997565 run osmo-stp_10.42.42.5(pid=18818): stdout: | (launched: 2022-12-08_22:00:14.231878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:16.169412 run osmo-stp_10.42.42.5(pid=18818): stderr: | 20221208220014422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220014422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220014422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220014422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220014423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220014423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220014423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:16.338215 run patchelf(pid=18821): Terminating (SIGINT) 22:00:16.524510 run patchelf(pid=18821): Terminated: ok {rc=0} 22:00:16.658663 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18818): Process ended prematurely: osmo-stp_10.42.42.5(pid=18818) [trial-2350↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18818)] [trial-2350↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:00:16.669503 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:00:16.699654 run osmo-hlr_10.42.42.2(pid=18815): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18815)] 22:00:16.752255 run osmo-hlr_10.42.42.2(pid=18815): stdout: | (launched: 2022-12-08_22:00:13.232927) 22:00:16.806135 run osmo-hlr_10.42.42.2(pid=18815): stderr: | 20221208220013430 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220013431 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220013431 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220013431 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220013431 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220013431 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220013443 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220013453 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220013453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220013453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:00:16.861908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18808): Terminating (SIGTERM) 22:00:16.906218 run iperf3-srv_10.42.42.10(pid=18809): Terminating (SIGTERM) 22:00:16.953614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18810): Terminating (SIGTERM) 22:00:16.998074 run iperf3-srv_10.42.42.10(pid=18811): Terminating (SIGTERM) 22:00:17.044760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18814): Terminating (SIGTERM) 22:00:17.089926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18817): Terminating (SIGTERM) 22:00:17.133122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18820): Terminating (SIGTERM) 22:00:17.176807 --- ParallelTerminationStrategy: PID 18808 died... 22:00:17.197161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18808): Terminated: ok {rc=0} 22:00:17.244145 --- ParallelTerminationStrategy: PID 18809 died... 22:00:17.263796 run iperf3-srv_10.42.42.10(pid=18809): Terminated {rc=256} 22:00:17.310601 --- ParallelTerminationStrategy: PID 18810 died... 22:00:17.330359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18810): Terminated: ok {rc=0} 22:00:17.377237 --- ParallelTerminationStrategy: PID 18811 died... 22:00:17.397245 run iperf3-srv_10.42.42.10(pid=18811): Terminated {rc=256} 22:00:17.444427 --- ParallelTerminationStrategy: PID 18814 died... 22:00:17.464295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18814): Terminated: ok {rc=0} 22:00:17.511150 --- ParallelTerminationStrategy: PID 18817 died... 22:00:17.530927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18817): Terminated: ok {rc=0} 22:00:17.577947 --- ParallelTerminationStrategy: PID 18820 died... 22:00:17.597659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18820): Terminated: ok {rc=0} 22:00:17.687153 bus /gobi_0: Setting Powered False 22:00:18.787655 bus /gobi_0: Setting Powered False 22:00:19.906499 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:00:21.052906 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:21.064403 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:00:21.122299 tst iperf3.py: using LAC 17027 22:00:21.242651 tst iperf3.py: using RAC 197 22:00:21.363551 tst iperf3.py: using CellId 17027 22:00:21.492259 tst iperf3.py: using BVCI 17028 22:00:21.612255 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:21.623879 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:21.635033 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:21.646216 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:21.657272 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:21.668225 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:21.679525 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:21.690599 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:21.701856 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:00:21.815520 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:00:22.017552 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:00:22.319228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18822): Launched 22:00:22.580120 run iperf3-srv_10.42.42.10(pid=18823): Launched 22:00:22.693326 tst iperf3.py:8: start network... 22:00:22.894689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:00:23.357984 run create_hlr_db(pid=18824): Launched 22:00:23.472776 bus /gobi_6: Setting Powered False 22:00:24.532834 run create_hlr_db(pid=18824): Terminated: ok {rc=0} 22:00:24.970388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18826): Launched 22:00:25.289032 run osmo-hlr_10.42.42.2(pid=18827): Launched 22:00:25.411432 run osmo-stp_10.42.42.5: Starting osmo-stp 22:00:25.966820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18829): Launched 22:00:26.287028 run osmo-stp_10.42.42.5(pid=18830): Launched 22:00:26.408731 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:00:26.961354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18832): Launched 22:00:27.083251 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:00:27.353248 run patchelf(pid=18833): Launched 22:00:27.531758 run osmo-stp_10.42.42.5(pid=18830): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18830)] 22:00:27.668365 run osmo-stp_10.42.42.5(pid=18830): stdout: | (launched: 2022-12-08_22:00:26.229372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:27.806069 run osmo-stp_10.42.42.5(pid=18830): stderr: | 20221208220026420 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220026420 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220026421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220026421 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220026421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220026421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220026422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:27.943864 run osmo-stp_10.42.42.5(pid=18830): stdout: | (launched: 2022-12-08_22:00:26.229372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:28.076314 run osmo-stp_10.42.42.5(pid=18830): stderr: | 20221208220026420 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220026420 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220026421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220026421 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220026421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220026421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220026422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:28.233844 run patchelf(pid=18833): Terminating (SIGINT) 22:00:28.414692 run patchelf(pid=18833): Terminated: ok {rc=0} 22:00:28.545099 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18830): Process ended prematurely: osmo-stp_10.42.42.5(pid=18830) [trial-2350↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18830)] [trial-2350↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 22:00:28.555318 tst iperf3.py:8: Test FAILED (7.5 sec) 22:00:28.583921 run osmo-hlr_10.42.42.2(pid=18827): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18827)] 22:00:28.634736 run osmo-hlr_10.42.42.2(pid=18827): stdout: | (launched: 2022-12-08_22:00:25.231729) 22:00:28.687498 run osmo-hlr_10.42.42.2(pid=18827): stderr: | 20221208220025429 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220025429 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220025429 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220025429 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220025429 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220025429 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220025441 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220025449 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220025449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220025449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:00:28.740553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18822): Terminating (SIGTERM) 22:00:28.782925 run iperf3-srv_10.42.42.10(pid=18823): Terminating (SIGTERM) 22:00:28.825410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18826): Terminating (SIGTERM) 22:00:28.867930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18829): Terminating (SIGTERM) 22:00:28.910483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18832): Terminating (SIGTERM) 22:00:28.953099 --- ParallelTerminationStrategy: PID 18822 died... 22:00:28.973409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18822): Terminated: ok {rc=0} 22:00:29.020450 --- ParallelTerminationStrategy: PID 18823 died... 22:00:29.040182 run iperf3-srv_10.42.42.10(pid=18823): Terminated {rc=256} 22:00:29.087315 --- ParallelTerminationStrategy: PID 18826 died... 22:00:29.107007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18826): Terminated: ok {rc=0} 22:00:29.153733 --- ParallelTerminationStrategy: PID 18829 died... 22:00:29.173592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18829): Terminated: ok {rc=0} 22:00:29.220221 --- ParallelTerminationStrategy: PID 18832 died... 22:00:29.240155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18832): Terminated: ok {rc=0} 22:00:29.328670 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:00:30.480162 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:30.491977 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:00:30.548897 tst iperf3m4.py: using LAC 17028 22:00:30.676266 tst iperf3m4.py: using RAC 198 22:00:30.801321 tst iperf3m4.py: using CellId 17028 22:00:30.942895 tst iperf3m4.py: using BVCI 17029 22:00:31.079836 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:31.092573 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:31.104430 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:31.117275 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:31.130050 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:31.142563 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:31.155211 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:31.167727 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:31.182143 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:00:31.302750 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:00:31.451134 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:00:31.599188 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:00:31.743665 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:00:31.980302 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:00:32.306501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18834): Launched 22:00:32.576612 run iperf3-srv_10.42.42.10(pid=18835): Launched 22:00:32.690628 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:00:32.892397 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:00:33.214294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18836): Launched 22:00:33.494552 run iperf3-srv_10.42.42.10(pid=18837): Launched 22:00:33.615117 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:00:33.832005 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:00:34.154827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18838): Launched 22:00:34.434907 run iperf3-srv_10.42.42.10(pid=18839): Launched 22:00:34.555748 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:00:34.772327 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:00:35.094845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18840): Launched 22:00:35.373939 run iperf3-srv_10.42.42.10(pid=18841): Launched 22:00:35.494731 tst iperf3m4.py:8: start network... 22:00:35.711474 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:00:36.209589 run create_hlr_db(pid=18842): Launched 22:00:36.340635 bus /gobi_6: Setting Powered False 22:00:37.405295 run create_hlr_db(pid=18842): Terminated: ok {rc=0} 22:00:37.852353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18844): Launched 22:00:38.173049 run osmo-hlr_10.42.42.2(pid=18845): Launched 22:00:38.295737 run osmo-stp_10.42.42.5: Starting osmo-stp 22:00:38.849632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18847): Launched 22:00:39.171366 run osmo-stp_10.42.42.5(pid=18848): Launched 22:00:39.292905 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:00:39.846575 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18850): Launched 22:00:39.969709 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:00:40.241257 run patchelf(pid=18851): Launched 22:00:40.421429 run osmo-stp_10.42.42.5(pid=18848): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18848)] 22:00:40.558685 run osmo-stp_10.42.42.5(pid=18848): stdout: | (launched: 2022-12-08_22:00:39.113345) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:40.697155 run osmo-stp_10.42.42.5(pid=18848): stderr: | 20221208220039306 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220039306 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220039306 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220039306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220039307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220039307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220039307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:40.835580 run osmo-stp_10.42.42.5(pid=18848): stdout: | (launched: 2022-12-08_22:00:39.113345) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:40.968806 run osmo-stp_10.42.42.5(pid=18848): stderr: | 20221208220039306 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220039306 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220039306 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220039306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220039307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220039307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220039307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:41.126672 run patchelf(pid=18851): Terminating (SIGINT) 22:00:41.308111 run patchelf(pid=18851): Terminated: ok {rc=0} 22:00:41.439667 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18848): Process ended prematurely: osmo-stp_10.42.42.5(pid=18848) [trial-2350↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18848)] [trial-2350↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:00:41.449906 tst iperf3m4.py:8: Test FAILED (11.0 sec) 22:00:41.479172 run osmo-hlr_10.42.42.2(pid=18845): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18845)] 22:00:41.530419 run osmo-hlr_10.42.42.2(pid=18845): stdout: | (launched: 2022-12-08_22:00:38.115150) 22:00:41.583447 run osmo-hlr_10.42.42.2(pid=18845): stderr: | 20221208220038313 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220038313 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220038313 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220038313 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220038313 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220038313 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220038326 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220038334 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220038334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220038334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:00:41.636663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18834): Terminating (SIGTERM) 22:00:41.679411 run iperf3-srv_10.42.42.10(pid=18835): Terminating (SIGTERM) 22:00:41.722429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18836): Terminating (SIGTERM) 22:00:41.765498 run iperf3-srv_10.42.42.10(pid=18837): Terminating (SIGTERM) 22:00:41.808415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18838): Terminating (SIGTERM) 22:00:41.852095 run iperf3-srv_10.42.42.10(pid=18839): Terminating (SIGTERM) 22:00:41.895256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18840): Terminating (SIGTERM) 22:00:41.938324 run iperf3-srv_10.42.42.10(pid=18841): Terminating (SIGTERM) 22:00:41.981336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18844): Terminating (SIGTERM) 22:00:42.024263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18847): Terminating (SIGTERM) 22:00:42.067570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18850): Terminating (SIGTERM) 22:00:42.110966 --- ParallelTerminationStrategy: PID 18834 died... 22:00:42.131312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18834): Terminated: ok {rc=0} 22:00:42.178943 --- ParallelTerminationStrategy: PID 18835 died... 22:00:42.198909 run iperf3-srv_10.42.42.10(pid=18835): Terminated {rc=256} 22:00:42.246397 --- ParallelTerminationStrategy: PID 18836 died... 22:00:42.266651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18836): Terminated: ok {rc=0} 22:00:42.314513 --- ParallelTerminationStrategy: PID 18837 died... 22:00:42.334575 run iperf3-srv_10.42.42.10(pid=18837): Terminated {rc=256} 22:00:42.382087 --- ParallelTerminationStrategy: PID 18838 died... 22:00:42.402364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18838): Terminated: ok {rc=0} 22:00:42.450027 --- ParallelTerminationStrategy: PID 18839 died... 22:00:42.469960 run iperf3-srv_10.42.42.10(pid=18839): Terminated {rc=256} 22:00:42.517221 --- ParallelTerminationStrategy: PID 18840 died... 22:00:42.537119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18840): Terminated: ok {rc=0} 22:00:42.584636 --- ParallelTerminationStrategy: PID 18841 died... 22:00:42.604450 run iperf3-srv_10.42.42.10(pid=18841): Terminated {rc=256} 22:00:42.651893 --- ParallelTerminationStrategy: PID 18844 died... 22:00:42.672198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18844): Terminated: ok {rc=0} 22:00:42.719876 --- ParallelTerminationStrategy: PID 18847 died... 22:00:42.739988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18847): Terminated: ok {rc=0} 22:00:42.787569 --- ParallelTerminationStrategy: PID 18850 died... 22:00:42.807506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18850): Terminated: ok {rc=0} 22:00:42.896411 bus /gobi_4: Setting Powered False 22:00:43.996604 bus /gobi_4: Setting Powered False 22:00:45.115183 bus /gobi_1: Setting Powered False 22:00:46.228449 bus /gobi_1: Setting Powered False 22:00:47.365872 bus /gobi_0: Setting Powered False 22:00:48.465874 bus /gobi_0: Setting Powered False 22:00:49.585515 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:00:50.689584 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:50.700740 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:00:50.757455 tst ping.py: using LAC 17029 22:00:50.875012 tst ping.py: using RAC 199 22:00:50.998059 tst ping.py: using CellId 17029 22:00:51.114510 tst ping.py: using BVCI 17030 22:00:51.222173 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:51.232869 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:51.243371 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:51.254123 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:51.264833 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:51.275615 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:51.286510 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:51.297300 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:00:51.413440 tst ping.py:19: start network... 22:00:51.611663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:00:52.068702 run create_hlr_db(pid=18852): Launched 22:00:52.181591 bus /gobi_6: Setting Powered False 22:00:53.241723 run create_hlr_db(pid=18852): Terminated: ok {rc=0} 22:00:53.676000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18854): Launched 22:00:53.992201 run osmo-hlr_10.42.42.2(pid=18855): Launched 22:00:54.112304 run osmo-stp_10.42.42.5: Starting osmo-stp 22:00:54.659597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18857): Launched 22:00:54.973617 run osmo-stp_10.42.42.5(pid=18858): Launched 22:00:55.094003 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:00:55.642241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18860): Launched 22:00:55.762611 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:00:56.029796 run patchelf(pid=18861): Launched 22:00:56.205569 run osmo-stp_10.42.42.5(pid=18858): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18858)] 22:00:56.340369 run osmo-stp_10.42.42.5(pid=18858): stdout: | (launched: 2022-12-08_22:00:54.917047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:56.477930 run osmo-stp_10.42.42.5(pid=18858): stderr: | 20221208220055108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220055108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220055109 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220055109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220055109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220055110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220055110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:56.614603 run osmo-stp_10.42.42.5(pid=18858): stdout: | (launched: 2022-12-08_22:00:54.917047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:56.744869 run osmo-stp_10.42.42.5(pid=18858): stderr: | 20221208220055108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220055108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220055109 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220055109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220055109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220055110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220055110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:56.899207 run patchelf(pid=18861): Terminating (SIGINT) 22:00:57.077668 run patchelf(pid=18861): Terminated: ok {rc=0} 22:00:57.206511 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18858): Process ended prematurely: osmo-stp_10.42.42.5(pid=18858) [trial-2350↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18858)] [trial-2350↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 22:00:57.216466 tst ping.py:22: Test FAILED (6.5 sec) 22:00:57.245132 run osmo-hlr_10.42.42.2(pid=18855): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18855)] 22:00:57.296296 run osmo-hlr_10.42.42.2(pid=18855): stdout: | (launched: 2022-12-08_22:00:53.935532) 22:00:57.349492 run osmo-hlr_10.42.42.2(pid=18855): stderr: | 20221208220054131 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220054131 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220054131 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220054131 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220054131 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220054132 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220054145 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220054153 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220054153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220054153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:00:57.404200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18854): Terminating (SIGTERM) 22:00:57.447607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18857): Terminating (SIGTERM) 22:00:57.490900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18860): Terminating (SIGTERM) 22:00:57.534374 --- ParallelTerminationStrategy: PID 18854 died... 22:00:57.554794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18854): Terminated: ok {rc=0} 22:00:57.602415 --- ParallelTerminationStrategy: PID 18857 died... 22:00:57.622434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18857): Terminated: ok {rc=0} 22:00:57.670025 --- ParallelTerminationStrategy: PID 18860 died... 22:00:57.690102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18860): Terminated: ok {rc=0} 22:00:57.779544 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:00:58.870066 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:58.882460 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:00:58.941401 tst ping_idle_ping.py: using LAC 17030 22:00:59.061275 tst ping_idle_ping.py: using RAC 200 22:00:59.178836 tst ping_idle_ping.py: using CellId 17030 22:00:59.301482 tst ping_idle_ping.py: using BVCI 17031 22:00:59.411798 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:59.422725 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:59.433344 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:59.444790 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:59.456006 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:59.467334 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:59.478947 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:59.490212 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:00:59.603419 tst ping_idle_ping.py:24: start network... 22:00:59.802089 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:01:00.264079 run create_hlr_db(pid=18862): Launched 22:01:00.377265 bus /gobi_6: Setting Powered False 22:01:01.459733 run create_hlr_db(pid=18862): Terminated: ok {rc=0} 22:01:01.892655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18864): Launched 22:01:02.206206 run osmo-hlr_10.42.42.2(pid=18865): Launched 22:01:02.320564 run osmo-stp_10.42.42.5: Starting osmo-stp 22:01:02.845169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18867): Launched 22:01:03.140900 run osmo-stp_10.42.42.5(pid=18868): Launched 22:01:03.253790 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:01:03.764850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18870): Launched 22:01:03.878782 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:01:04.128768 run patchelf(pid=18871): Launched 22:01:04.294163 run osmo-stp_10.42.42.5(pid=18868): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18868)] 22:01:04.421220 run osmo-stp_10.42.42.5(pid=18868): stdout: | (launched: 2022-12-08_22:01:03.087482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:04.549893 run osmo-stp_10.42.42.5(pid=18868): stderr: | 20221208220103255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220103255 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220103255 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220103256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220103256 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220103256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220103256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:04.678289 run osmo-stp_10.42.42.5(pid=18868): stdout: | (launched: 2022-12-08_22:01:03.087482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:04.800886 run osmo-stp_10.42.42.5(pid=18868): stderr: | 20221208220103255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220103255 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220103255 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220103256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220103256 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220103256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220103256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:04.946464 run patchelf(pid=18871): Terminating (SIGINT) 22:01:05.114247 run patchelf(pid=18871): Terminated: ok {rc=0} 22:01:05.234881 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18868): Process ended prematurely: osmo-stp_10.42.42.5(pid=18868) [trial-2350↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18868)] [trial-2350↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:01:05.243581 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:01:05.270855 run osmo-hlr_10.42.42.2(pid=18865): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18865)] 22:01:05.319593 run osmo-hlr_10.42.42.2(pid=18865): stdout: | (launched: 2022-12-08_22:01:02.151378) 22:01:05.370105 run osmo-hlr_10.42.42.2(pid=18865): stderr: | 20221208220102324 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220102324 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220102325 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220102325 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220102325 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220102325 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220102337 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220102345 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220102346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220102346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:01:05.421030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18864): Terminating (SIGTERM) 22:01:05.461928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18867): Terminating (SIGTERM) 22:01:05.502531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18870): Terminating (SIGTERM) 22:01:05.543358 --- ParallelTerminationStrategy: PID 18864 died... 22:01:05.562646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18864): Terminated: ok {rc=0} 22:01:05.607862 --- ParallelTerminationStrategy: PID 18867 died... 22:01:05.626858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18867): Terminated: ok {rc=0} 22:01:05.672026 --- ParallelTerminationStrategy: PID 18870 died... 22:01:05.691083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18870): Terminated: ok {rc=0} 22:01:05.775870 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:01:07.066825 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:01:07.072664 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:01:07.092665 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 22:01:07.131266 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 22:01:07.216104 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:01:07.236043 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 22:01:07.273583 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 22:01:07.865949 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 22:01:07.914407 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:07.925171 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:01:07.981166 tst cs_paging_gprs_active.py: using LAC 17031 22:01:08.101592 tst cs_paging_gprs_active.py: using RAC 201 22:01:08.228826 tst cs_paging_gprs_active.py: using CellId 17031 22:01:08.356004 tst cs_paging_gprs_active.py: using BVCI 17032 22:01:08.474071 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:08.485679 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:08.496810 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:08.508527 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:08.520132 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:08.531622 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:08.543283 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:08.554770 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:08.565980 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:01:08.685523 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:01:08.800522 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:01:09.003490 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:01:09.306412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18877): Launched 22:01:09.573831 run iperf3-srv_10.42.42.10(pid=18878): Launched 22:01:09.688791 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:01:09.892503 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:01:10.197342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18879): Launched 22:01:10.461507 run iperf3-srv_10.42.42.10(pid=18880): Launched 22:01:10.575820 tst cs_paging_gprs_active.py:38: start network... 22:01:10.778617 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:01:11.248192 run create_hlr_db(pid=18881): Launched 22:01:11.364415 bus /gobi_6: Setting Powered False 22:01:12.425439 run create_hlr_db(pid=18881): Terminated: ok {rc=0} 22:01:12.867027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18883): Launched 22:01:13.188446 run osmo-hlr_10.42.42.2(pid=18884): Launched 22:01:13.311282 run osmo-stp_10.42.42.5: Starting osmo-stp 22:01:13.867070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18886): Launched 22:01:14.188829 run osmo-stp_10.42.42.5(pid=18887): Launched 22:01:14.311137 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:01:14.866265 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18889): Launched 22:01:14.989207 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:01:15.259754 run patchelf(pid=18890): Launched 22:01:15.438942 run osmo-stp_10.42.42.5(pid=18887): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18887)] 22:01:15.575445 run osmo-stp_10.42.42.5(pid=18887): stdout: | (launched: 2022-12-08_22:01:14.131169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:15.713705 run osmo-stp_10.42.42.5(pid=18887): stderr: | 20221208220114325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220114325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220114325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220114326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220114326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220114326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220114326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:15.865731 run osmo-stp_10.42.42.5(pid=18887): stdout: | (launched: 2022-12-08_22:01:14.131169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:16.026728 run osmo-stp_10.42.42.5(pid=18887): stderr: | 20221208220114325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220114325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220114325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220114326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220114326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220114326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220114326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:16.180712 run patchelf(pid=18890): Terminating (SIGINT) 22:01:16.356425 run patchelf(pid=18890): Terminated: ok {rc=0} 22:01:16.485297 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18887): Process ended prematurely: osmo-stp_10.42.42.5(pid=18887) [trial-2350↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18887)] [trial-2350↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 22:01:16.495877 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 22:01:16.526993 run osmo-hlr_10.42.42.2(pid=18884): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18884)] 22:01:16.578732 run osmo-hlr_10.42.42.2(pid=18884): stdout: | (launched: 2022-12-08_22:01:13.130676) 22:01:16.641684 run osmo-hlr_10.42.42.2(pid=18884): stderr: | 20221208220113327 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220113327 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220113327 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220113328 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220113328 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220113328 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220113340 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220113348 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220113348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220113348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:01:16.712214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18877): Terminating (SIGTERM) 22:01:16.767920 run iperf3-srv_10.42.42.10(pid=18878): Terminating (SIGTERM) 22:01:16.826455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18879): Terminating (SIGTERM) 22:01:16.880353 run iperf3-srv_10.42.42.10(pid=18880): Terminating (SIGTERM) 22:01:16.940171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18883): Terminating (SIGTERM) 22:01:16.995108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18886): Terminating (SIGTERM) 22:01:17.046939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18889): Terminating (SIGTERM) 22:01:17.101768 --- ParallelTerminationStrategy: PID 18877 died... 22:01:17.127335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18877): Terminated: ok {rc=0} 22:01:17.177162 --- ParallelTerminationStrategy: PID 18878 died... 22:01:17.197707 run iperf3-srv_10.42.42.10(pid=18878): Terminated {rc=256} 22:01:17.245552 --- ParallelTerminationStrategy: PID 18879 died... 22:01:17.265358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18879): Terminated: ok {rc=0} 22:01:17.312130 --- ParallelTerminationStrategy: PID 18880 died... 22:01:17.331989 run iperf3-srv_10.42.42.10(pid=18880): Terminated {rc=256} 22:01:17.378749 --- ParallelTerminationStrategy: PID 18883 died... 22:01:17.398527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18883): Terminated: ok {rc=0} 22:01:17.445616 --- ParallelTerminationStrategy: PID 18886 died... 22:01:17.465284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18886): Terminated: ok {rc=0} 22:01:17.512098 --- ParallelTerminationStrategy: PID 18889 died... 22:01:17.531776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18889): Terminated: ok {rc=0} 22:01:17.620393 bus /gobi_0: Setting Powered False 22:01:18.719642 bus /gobi_0: Setting Powered False 22:01:19.836884 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 22:01:20.982961 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:20.994314 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:01:21.054433 tst iperf3.py: using LAC 17032 22:01:21.182702 tst iperf3.py: using RAC 202 22:01:21.308631 tst iperf3.py: using CellId 17032 22:01:21.436706 tst iperf3.py: using BVCI 17033 22:01:21.555013 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:21.566546 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:21.577700 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:21.588711 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:21.599672 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:21.610684 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:21.621832 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:21.632685 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:21.643831 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:01:21.758468 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:01:21.960011 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:01:22.261463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18891): Launched 22:01:22.524370 run iperf3-srv_10.42.42.10(pid=18892): Launched 22:01:22.638111 tst iperf3.py:8: start network... 22:01:22.839485 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:01:23.305688 run create_hlr_db(pid=18893): Launched 22:01:23.421787 bus /gobi_6: Setting Powered False 22:01:24.482414 run create_hlr_db(pid=18893): Terminated: ok {rc=0} 22:01:24.903896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18895): Launched 22:01:25.204717 run osmo-hlr_10.42.42.2(pid=18896): Launched 22:01:25.320525 run osmo-stp_10.42.42.5: Starting osmo-stp 22:01:25.843344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18898): Launched 22:01:26.142149 run osmo-stp_10.42.42.5(pid=18899): Launched 22:01:26.255952 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:01:26.774295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18901): Launched 22:01:26.889302 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:01:27.144014 run patchelf(pid=18902): Launched 22:01:27.311836 run osmo-stp_10.42.42.5(pid=18899): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18899)] 22:01:27.439820 run osmo-stp_10.42.42.5(pid=18899): stdout: | (launched: 2022-12-08_22:01:26.088043) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:27.569795 run osmo-stp_10.42.42.5(pid=18899): stderr: | 20221208220126258 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220126258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220126258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220126259 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220126259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220126259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220126259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:27.699718 run osmo-stp_10.42.42.5(pid=18899): stdout: | (launched: 2022-12-08_22:01:26.088043) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:27.824685 run osmo-stp_10.42.42.5(pid=18899): stderr: | 20221208220126258 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220126258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220126258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220126259 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220126259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220126259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220126259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:27.972489 run patchelf(pid=18902): Terminating (SIGINT) 22:01:28.143097 run patchelf(pid=18902): Terminated: ok {rc=0} 22:01:28.265543 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18899): Process ended prematurely: osmo-stp_10.42.42.5(pid=18899) [trial-2350↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18899)] [trial-2350↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 22:01:28.275104 tst iperf3.py:8: Test FAILED (7.3 sec) 22:01:28.302766 run osmo-hlr_10.42.42.2(pid=18896): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18896)] 22:01:28.351792 run osmo-hlr_10.42.42.2(pid=18896): stdout: | (launched: 2022-12-08_22:01:25.150211) 22:01:28.402473 run osmo-hlr_10.42.42.2(pid=18896): stderr: | 20221208220125327 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220125327 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220125327 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220125327 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220125327 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220125327 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220125339 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220125348 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220125348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220125348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:01:28.453617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18891): Terminating (SIGTERM) 22:01:28.494388 run iperf3-srv_10.42.42.10(pid=18892): Terminating (SIGTERM) 22:01:28.535071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18895): Terminating (SIGTERM) 22:01:28.575791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18898): Terminating (SIGTERM) 22:01:28.616381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18901): Terminating (SIGTERM) 22:01:28.657711 --- ParallelTerminationStrategy: PID 18891 died... 22:01:28.676820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18891): Terminated: ok {rc=0} 22:01:28.722295 --- ParallelTerminationStrategy: PID 18892 died... 22:01:28.741053 run iperf3-srv_10.42.42.10(pid=18892): Terminated {rc=256} 22:01:28.786570 --- ParallelTerminationStrategy: PID 18895 died... 22:01:28.805352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18895): Terminated: ok {rc=0} 22:01:28.850359 --- ParallelTerminationStrategy: PID 18898 died... 22:01:28.869099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18898): Terminated: ok {rc=0} 22:01:28.914062 --- ParallelTerminationStrategy: PID 18901 died... 22:01:28.932714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18901): Terminated: ok {rc=0} 22:01:29.019070 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 22:01:30.166703 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:30.178209 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:01:30.236882 tst iperf3m4.py: using LAC 17033 22:01:30.356687 tst iperf3m4.py: using RAC 203 22:01:30.476085 tst iperf3m4.py: using CellId 17033 22:01:30.597838 tst iperf3m4.py: using BVCI 17034 22:01:30.709214 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:30.720082 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:30.730630 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:30.742029 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:30.753262 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:30.764320 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:30.775638 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:30.786928 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:30.798380 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:01:30.949358 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:01:31.096653 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:01:31.236160 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:01:31.353573 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:01:31.606726 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:01:31.941686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18903): Launched 22:01:32.237944 run iperf3-srv_10.42.42.10(pid=18904): Launched 22:01:32.350629 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:01:32.551570 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:01:32.852817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18905): Launched 22:01:33.114362 run iperf3-srv_10.42.42.10(pid=18906): Launched 22:01:33.227269 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:01:33.428385 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:01:33.729956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18907): Launched 22:01:33.991854 run iperf3-srv_10.42.42.10(pid=18908): Launched 22:01:34.104690 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:01:34.306097 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:01:34.607651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18909): Launched 22:01:34.869383 run iperf3-srv_10.42.42.10(pid=18910): Launched 22:01:34.982684 tst iperf3m4.py:8: start network... 22:01:35.184859 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:01:35.652869 run create_hlr_db(pid=18911): Launched 22:01:35.768085 bus /gobi_6: Setting Powered False 22:01:36.829150 run create_hlr_db(pid=18911): Terminated: ok {rc=0} 22:01:37.248051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18913): Launched 22:01:37.548280 run osmo-hlr_10.42.42.2(pid=18914): Launched 22:01:37.663363 run osmo-stp_10.42.42.5: Starting osmo-stp 22:01:38.181929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18916): Launched 22:01:38.482451 run osmo-stp_10.42.42.5(pid=18917): Launched 22:01:38.597664 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:01:39.117194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18919): Launched 22:01:39.232493 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:01:39.486394 run patchelf(pid=18920): Launched 22:01:39.653917 run osmo-stp_10.42.42.5(pid=18917): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18917)] 22:01:39.781865 run osmo-stp_10.42.42.5(pid=18917): stdout: | (launched: 2022-12-08_22:01:38.427213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:39.911273 run osmo-stp_10.42.42.5(pid=18917): stderr: | 20221208220138597 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220138597 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220138597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220138598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220138598 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220138598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220138598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:40.041323 run osmo-stp_10.42.42.5(pid=18917): stdout: | (launched: 2022-12-08_22:01:38.427213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:40.165914 run osmo-stp_10.42.42.5(pid=18917): stderr: | 20221208220138597 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220138597 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220138597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220138598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220138598 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220138598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220138598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:40.313389 run patchelf(pid=18920): Terminating (SIGINT) 22:01:40.482627 run patchelf(pid=18920): Terminated: ok {rc=0} 22:01:40.604607 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18917): Process ended prematurely: osmo-stp_10.42.42.5(pid=18917) [trial-2350↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18917)] [trial-2350↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 22:01:40.614179 tst iperf3m4.py:8: Test FAILED (10.5 sec) 22:01:40.642057 run osmo-hlr_10.42.42.2(pid=18914): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18914)] 22:01:40.691144 run osmo-hlr_10.42.42.2(pid=18914): stdout: | (launched: 2022-12-08_22:01:37.493950) 22:01:40.742223 run osmo-hlr_10.42.42.2(pid=18914): stderr: | 20221208220137669 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220137669 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220137669 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220137669 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220137669 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220137669 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220137681 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220137690 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220137690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220137690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:01:40.793246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18903): Terminating (SIGTERM) 22:01:40.833819 run iperf3-srv_10.42.42.10(pid=18904): Terminating (SIGTERM) 22:01:40.874300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18905): Terminating (SIGTERM) 22:01:40.914842 run iperf3-srv_10.42.42.10(pid=18906): Terminating (SIGTERM) 22:01:40.955415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18907): Terminating (SIGTERM) 22:01:40.996185 run iperf3-srv_10.42.42.10(pid=18908): Terminating (SIGTERM) 22:01:41.036653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18909): Terminating (SIGTERM) 22:01:41.077415 run iperf3-srv_10.42.42.10(pid=18910): Terminating (SIGTERM) 22:01:41.117829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18913): Terminating (SIGTERM) 22:01:41.158480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18916): Terminating (SIGTERM) 22:01:41.198920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18919): Terminating (SIGTERM) 22:01:41.239532 --- ParallelTerminationStrategy: PID 18903 died... 22:01:41.258970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18903): Terminated: ok {rc=0} 22:01:41.304499 --- ParallelTerminationStrategy: PID 18904 died... 22:01:41.323344 run iperf3-srv_10.42.42.10(pid=18904): Terminated {rc=256} 22:01:41.368481 --- ParallelTerminationStrategy: PID 18905 died... 22:01:41.387328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18905): Terminated: ok {rc=0} 22:01:41.432516 --- ParallelTerminationStrategy: PID 18906 died... 22:01:41.451281 run iperf3-srv_10.42.42.10(pid=18906): Terminated {rc=256} 22:01:41.496232 --- ParallelTerminationStrategy: PID 18907 died... 22:01:41.515089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18907): Terminated: ok {rc=0} 22:01:41.560689 --- ParallelTerminationStrategy: PID 18908 died... 22:01:41.579471 run iperf3-srv_10.42.42.10(pid=18908): Terminated {rc=256} 22:01:41.624416 --- ParallelTerminationStrategy: PID 18909 died... 22:01:41.643201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18909): Terminated: ok {rc=0} 22:01:41.688673 --- ParallelTerminationStrategy: PID 18910 died... 22:01:41.707565 run iperf3-srv_10.42.42.10(pid=18910): Terminated {rc=256} 22:01:41.752814 --- ParallelTerminationStrategy: PID 18913 died... 22:01:41.772163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18913): Terminated: ok {rc=0} 22:01:41.817857 --- ParallelTerminationStrategy: PID 18916 died... 22:01:41.836692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18916): Terminated: ok {rc=0} 22:01:41.881949 --- ParallelTerminationStrategy: PID 18919 died... 22:01:41.900735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18919): Terminated: ok {rc=0} 22:01:41.988535 bus /gobi_4: Setting Powered False 22:01:43.089095 bus /gobi_4: Setting Powered False 22:01:44.206320 bus /gobi_1: Setting Powered False 22:01:45.310736 bus /gobi_1: Setting Powered False 22:01:46.428368 bus /gobi_0: Setting Powered False 22:01:47.528918 bus /gobi_0: Setting Powered False 22:01:48.643978 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 22:01:49.749500 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:49.761408 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:01:49.821076 tst ping.py: using LAC 17034 22:01:49.946066 tst ping.py: using RAC 204 22:01:50.070757 tst ping.py: using CellId 17034 22:01:50.195709 tst ping.py: using BVCI 17035 22:01:50.311882 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:50.323173 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:50.334238 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:50.345314 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:50.356279 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:50.367247 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:50.378424 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:50.389485 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:01:50.502008 tst ping.py:19: start network... 22:01:50.700136 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:01:51.157932 run create_hlr_db(pid=18921): Launched 22:01:51.271219 bus /gobi_6: Setting Powered False 22:01:52.330945 run create_hlr_db(pid=18921): Terminated: ok {rc=0} 22:01:52.764407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18923): Launched 22:01:53.074048 run osmo-hlr_10.42.42.2(pid=18924): Launched 22:01:53.188231 run osmo-stp_10.42.42.5: Starting osmo-stp 22:01:53.699183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18926): Launched 22:01:53.994782 run osmo-stp_10.42.42.5(pid=18927): Launched 22:01:54.107226 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:01:54.617095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18929): Launched 22:01:54.730132 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:01:54.980250 run patchelf(pid=18930): Launched 22:01:55.144887 run osmo-stp_10.42.42.5(pid=18927): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18927)] 22:01:55.271661 run osmo-stp_10.42.42.5(pid=18927): stdout: | (launched: 2022-12-08_22:01:53.941343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:55.400171 run osmo-stp_10.42.42.5(pid=18927): stderr: | 20221208220154110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220154110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220154110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220154111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220154111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220154111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220154111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:55.528384 run osmo-stp_10.42.42.5(pid=18927): stdout: | (launched: 2022-12-08_22:01:53.941343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:55.651482 run osmo-stp_10.42.42.5(pid=18927): stderr: | 20221208220154110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220154110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220154110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220154111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220154111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220154111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220154111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:55.796260 run patchelf(pid=18930): Terminating (SIGINT) 22:01:55.963192 run patchelf(pid=18930): Terminated: ok {rc=0} 22:01:56.083243 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18927): Process ended prematurely: osmo-stp_10.42.42.5(pid=18927) [trial-2350↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18927)] [trial-2350↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 22:01:56.092355 tst ping.py:22: Test FAILED (6.3 sec) 22:01:56.119973 run osmo-hlr_10.42.42.2(pid=18924): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18924)] 22:01:56.169116 run osmo-hlr_10.42.42.2(pid=18924): stdout: | (launched: 2022-12-08_22:01:53.020585) 22:01:56.220009 run osmo-hlr_10.42.42.2(pid=18924): stderr: | 20221208220153193 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220153193 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220153193 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220153193 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220153193 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220153193 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220153206 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220153214 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220153214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220153214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:01:56.271453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18923): Terminating (SIGTERM) 22:01:56.312404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18926): Terminating (SIGTERM) 22:01:56.353325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18929): Terminating (SIGTERM) 22:01:56.394312 --- ParallelTerminationStrategy: PID 18923 died... 22:01:56.413871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18923): Terminated: ok {rc=0} 22:01:56.459707 --- ParallelTerminationStrategy: PID 18926 died... 22:01:56.478627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18926): Terminated: ok {rc=0} 22:01:56.524575 --- ParallelTerminationStrategy: PID 18929 died... 22:01:56.543658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18929): Terminated: ok {rc=0} 22:01:56.632010 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 22:01:57.722824 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:57.734751 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:01:57.793559 tst ping_idle_ping.py: using LAC 17035 22:01:57.918830 tst ping_idle_ping.py: using RAC 205 22:01:58.043214 tst ping_idle_ping.py: using CellId 17035 22:01:58.168558 tst ping_idle_ping.py: using BVCI 17036 22:01:58.283601 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:58.294955 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:58.306083 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:58.317276 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:58.328310 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:58.339349 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:58.350596 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:58.361646 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:01:58.479109 tst ping_idle_ping.py:24: start network... 22:01:58.692630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:01:59.187252 run create_hlr_db(pid=18931): Launched 22:01:59.314215 bus /gobi_6: Setting Powered False 22:02:00.376742 run create_hlr_db(pid=18931): Terminated: ok {rc=0} 22:02:00.816001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18933): Launched 22:02:01.150690 run osmo-hlr_10.42.42.2(pid=18934): Launched 22:02:01.398662 run osmo-stp_10.42.42.5: Starting osmo-stp 22:02:01.994536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18936): Launched 22:02:02.305706 run osmo-stp_10.42.42.5(pid=18937): Launched 22:02:02.449801 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:02:02.982880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18939): Launched 22:02:03.097632 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:02:03.348145 run patchelf(pid=18940): Launched 22:02:03.514366 run osmo-stp_10.42.42.5(pid=18937): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18937)] 22:02:03.641458 run osmo-stp_10.42.42.5(pid=18937): stdout: | (launched: 2022-12-08_22:02:02.248013) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:03.769370 run osmo-stp_10.42.42.5(pid=18937): stderr: | 20221208220202471 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220202472 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220202472 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220202472 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220202473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220202473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220202473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:03.898219 run osmo-stp_10.42.42.5(pid=18937): stdout: | (launched: 2022-12-08_22:02:02.248013) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:04.020713 run osmo-stp_10.42.42.5(pid=18937): stderr: | 20221208220202471 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220202472 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220202472 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220202472 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220202473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220202473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220202473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:04.165860 run patchelf(pid=18940): Terminating (SIGINT) 22:02:04.333282 run patchelf(pid=18940): Terminated: ok {rc=0} 22:02:04.454715 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18937): Process ended prematurely: osmo-stp_10.42.42.5(pid=18937) [trial-2350↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18937)] [trial-2350↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 22:02:04.463680 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 22:02:04.490755 run osmo-hlr_10.42.42.2(pid=18934): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18934)] 22:02:04.539940 run osmo-hlr_10.42.42.2(pid=18934): stdout: | (launched: 2022-12-08_22:02:01.086190) 22:02:04.590757 run osmo-hlr_10.42.42.2(pid=18934): stderr: | 20221208220201329 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220201329 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220201329 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220201329 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220201329 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220201329 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220201348 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220201366 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220201366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220201366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:02:04.641922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18933): Terminating (SIGTERM) 22:02:04.682987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18936): Terminating (SIGTERM) 22:02:04.724017 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18939): Terminating (SIGTERM) 22:02:04.765376 --- ParallelTerminationStrategy: PID 18933 died... 22:02:04.785033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18933): Terminated: ok {rc=0} 22:02:04.830899 --- ParallelTerminationStrategy: PID 18936 died... 22:02:04.849876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18936): Terminated: ok {rc=0} 22:02:04.895292 --- ParallelTerminationStrategy: PID 18939 died... 22:02:04.914683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18939): Terminated: ok {rc=0} 22:02:05.002990 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:02:06.289563 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:02:06.296309 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:02:06.317375 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:02:06.351929 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:02:06.406537 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:02:06.428860 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:02:06.465521 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:02:07.015371 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2350 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:02:07.021450 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:02:07.032869 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:02:07.088573 tst switch_tch_pdch.py: using LAC 17036 22:02:07.205761 tst switch_tch_pdch.py: using RAC 206 22:02:07.323087 tst switch_tch_pdch.py: using CellId 17036 22:02:07.441070 tst switch_tch_pdch.py: using BVCI 17037 22:02:07.548748 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:02:07.559823 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:02:07.570619 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:02:07.581756 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:02:07.592553 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:02:07.603690 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:02:07.614863 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:02:07.625952 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:02:07.744585 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:02:07.863130 tst switch_tch_pdch.py:51: start network... 22:02:08.074050 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:02:08.560702 run create_hlr_db(pid=18944): Launched 22:02:08.689398 bus /gobi_6: Setting Powered False 22:02:09.752224 run create_hlr_db(pid=18944): Terminated: ok {rc=0} 22:02:10.189991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18946): Launched 22:02:10.502667 run osmo-hlr_10.42.42.2(pid=18947): Launched 22:02:10.621404 run osmo-stp_10.42.42.5: Starting osmo-stp 22:02:11.166901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18949): Launched 22:02:11.481059 run osmo-stp_10.42.42.5(pid=18950): Launched 22:02:11.601935 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:02:12.145331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18952): Launched 22:02:12.265440 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:02:12.531288 run patchelf(pid=18953): Launched 22:02:12.706961 run osmo-stp_10.42.42.5(pid=18950): ERR: Terminated: ERROR {rc=1} [trial-2350↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18950)] 22:02:12.841480 run osmo-stp_10.42.42.5(pid=18950): stdout: | (launched: 2022-12-08_22:02:11.424033) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:12.977826 run osmo-stp_10.42.42.5(pid=18950): stderr: | 20221208220211614 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220211614 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220211614 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220211615 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220211615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220211615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220211615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:13.113928 run osmo-stp_10.42.42.5(pid=18950): stdout: | (launched: 2022-12-08_22:02:11.424033) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:13.244096 run osmo-stp_10.42.42.5(pid=18950): stderr: | 20221208220211614 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220211614 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220211614 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220211615 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220211615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220211615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220211615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:13.398349 run patchelf(pid=18953): Terminating (SIGINT) 22:02:13.576219 run patchelf(pid=18953): Terminated: ok {rc=0} 22:02:13.704326 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=18950): Process ended prematurely: osmo-stp_10.42.42.5(pid=18950) [trial-2350↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18950)] [trial-2350↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:02:13.713742 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 22:02:13.741802 run osmo-hlr_10.42.42.2(pid=18947): ERR: Terminated: ERROR {rc=237} [trial-2350↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18947)] 22:02:13.792451 run osmo-hlr_10.42.42.2(pid=18947): stdout: | (launched: 2022-12-08_22:02:10.446388) 22:02:13.844896 run osmo-hlr_10.42.42.2(pid=18947): stderr: | 20221208220210643 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220210643 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220210643 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220210643 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220210643 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220210643 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220210655 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220210667 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220210667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220210667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:02:13.897702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18946): Terminating (SIGTERM) 22:02:13.940019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18949): Terminating (SIGTERM) 22:02:13.982581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18952): Terminating (SIGTERM) 22:02:14.025088 --- ParallelTerminationStrategy: PID 18946 died... 22:02:14.045278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18946): Terminated: ok {rc=0} 22:02:14.091877 --- ParallelTerminationStrategy: PID 18949 died... 22:02:14.111351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18949): Terminated: ok {rc=0} 22:02:14.157676 --- ParallelTerminationStrategy: PID 18952 died... 22:02:14.177231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18952): Terminated: ok {rc=0} 22:02:14.265352 bus /gobi_0: Setting Powered False 22:02:15.364154 bus /gobi_0: Setting Powered False 22:02:16.504842 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 22:02:17.754348 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:02:17.760304 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 22:02:17.781140 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 22:02:17.816266 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 22:02:17.871004 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 22:02:17.891712 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 22:02:17.926405 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 22:02:18.481990 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2350 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 22:02:18.487147 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:02:18.498382 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 22:02:18.555638 tst switch_tch_pdch.py: using LAC 17037 22:02:18.678511 tst switch_tch_pdch.py: using RAC 207 22:02:18.802455 tst switch_tch_pdch.py: using CellId 17037 22:02:18.924786 tst switch_tch_pdch.py: using BVCI 17038 22:02:19.038896 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:02:19.050205 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:02:19.061286 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:02:19.072199 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:02:19.083166 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:02:19.094104 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:02:19.105393 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:02:19.116318 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:02:19.229194 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:02:19.342234 tst switch_tch_pdch.py:51: start network... 22:02:19.539135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:02:19.969437 run create_hlr_db(pid=18958): Launched 22:02:20.083426 bus /gobi_6: Setting Powered False 22:02:21.142857 run create_hlr_db(pid=18958): Terminated: ok {rc=0} 22:02:21.548807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18960): Launched 22:02:21.864381 run osmo-hlr_10.42.42.2(pid=18961): Launched 22:02:21.983997 run osmo-stp_10.42.42.5: Starting osmo-stp 22:02:22.503877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18963): Launched 22:02:22.817387 run osmo-stp_10.42.42.5(pid=18964): Launched 22:02:22.937587 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:02:23.456565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18966): Launched 22:02:23.577081 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:02:23.842995 run patchelf(pid=18967): Launched 22:02:24.017688 run osmo-stp_10.42.42.5(pid=18964): ERR: Terminated: ERROR {rc=1} [trial-2350↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18964)] 22:02:24.152129 run osmo-stp_10.42.42.5(pid=18964): stdout: | (launched: 2022-12-08_22:02:22.760796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:24.287616 run osmo-stp_10.42.42.5(pid=18964): stderr: | 20221208220222952 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220222952 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220222953 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220222953 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220222954 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220222954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220222954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:24.423665 run osmo-stp_10.42.42.5(pid=18964): stdout: | (launched: 2022-12-08_22:02:22.760796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:24.554442 run osmo-stp_10.42.42.5(pid=18964): stderr: | 20221208220222952 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220222952 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220222953 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220222953 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220222954 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220222954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220222954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:24.708097 run patchelf(pid=18967): Terminating (SIGINT) 22:02:24.885300 run patchelf(pid=18967): Terminated: ok {rc=0} 22:02:25.012778 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=18964): Process ended prematurely: osmo-stp_10.42.42.5(pid=18964) [trial-2350↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18964)] [trial-2350↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 22:02:25.022468 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 22:02:25.050578 run osmo-hlr_10.42.42.2(pid=18961): ERR: Terminated: ERROR {rc=237} [trial-2350↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18961)] 22:02:25.102175 run osmo-hlr_10.42.42.2(pid=18961): stdout: | (launched: 2022-12-08_22:02:21.806527) 22:02:25.155200 run osmo-hlr_10.42.42.2(pid=18961): stderr: | 20221208220222005 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220222005 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220222005 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220222005 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220222005 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220222005 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220222018 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220222028 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220222028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220222028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:02:25.208391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18960): Terminating (SIGTERM) 22:02:25.251323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18963): Terminating (SIGTERM) 22:02:25.294127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18966): Terminating (SIGTERM) 22:02:25.337104 --- ParallelTerminationStrategy: PID 18960 died... 22:02:25.357392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18960): Terminated: ok {rc=0} 22:02:25.404518 --- ParallelTerminationStrategy: PID 18963 died... 22:02:25.424225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18963): Terminated: ok {rc=0} 22:02:25.471436 --- ParallelTerminationStrategy: PID 18966 died... 22:02:25.491404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18966): Terminated: ok {rc=0} 22:02:25.580062 bus /gobi_0: Setting Powered False 22:02:26.680239 bus /gobi_0: Setting Powered False 22:02:27.798896 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 nitb_sms:trx-b200 --------------------------------------------------------------------- 22:02:29.032822 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:02:29.037328 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 22:02:29.071634 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 22:02:29.078210 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 22:02:29.129388 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 22:02:29.161658 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 22:02:29.168188 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 22:02:29.711067 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 22:02:29.716489 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 22:02:29.727949 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 22:02:29.778887 tst mo_mt_sms.py: using LAC 17038 22:02:29.895053 tst mo_mt_sms.py: using RAC 208 22:02:30.009936 tst mo_mt_sms.py: using CellId 17038 22:02:30.126659 tst mo_mt_sms.py: using BVCI 17039 22:02:30.233895 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 22:02:30.349241 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 22:02:30.463231 tst mo_mt_sms.py:9: start nitb and bts... 22:02:30.677723 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:02:31.365867 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18972): Launched 22:02:31.703204 run osmo-nitb_10.42.42.2(pid=18973): Launched 22:02:31.893787 run osmo-nitb_10.42.42.2(pid=18973): ERR: Terminated: ERROR {rc=2} [trial-2350↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18973)] 22:02:32.039072 run osmo-nitb_10.42.42.2(pid=18973): stdout: | (launched: 2022-12-08_22:02:31.638199) 22:02:32.186256 run osmo-nitb_10.42.42.2(pid=18973): stderr: | (launched: 2022-12-08_22:02:31.685891) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:02:32.330826 run osmo-nitb_10.42.42.2(pid=18973): stdout: | (launched: 2022-12-08_22:02:31.638199) 22:02:32.470274 run osmo-nitb_10.42.42.2(pid=18973): stderr: | (launched: 2022-12-08_22:02:31.685891) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3c9519268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=18973): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18973) [trial-2350↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18973)] 22:02:32.836811 tst osmo-nitb_10.42.42.2(pid=18973): stdout: | (launched: 2022-12-08_22:02:31.638199) 22:02:32.957032 tst osmo-nitb_10.42.42.2(pid=18973): stderr: | (launched: 2022-12-08_22:02:31.685891) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:02:33.098219 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=18973): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18973) [trial-2350↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18973)] [trial-2350↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 22:02:33.106569 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 22:02:33.113188 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18972): Terminating (SIGTERM) 22:02:33.325224 --- ParallelTerminationStrategy: PID 18972 died... 22:02:33.345855 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18972): Terminated: ok {rc=0} 22:02:33.433998 bus /sierra_3: Setting Powered False 22:02:34.535170 bus /sierra_3: Setting Powered False 22:02:35.655579 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 sms:trx-b200 --------------------------------------------------------------------- 22:02:36.859723 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:02:36.864419 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 22:02:36.898303 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 22:02:36.924485 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 22:02:36.974948 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 22:02:37.008395 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 22:02:37.035301 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 22:02:37.579957 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 22:02:37.586132 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:37.597357 tst sms:trx-b200: Using 1 x bts (candidates: 1) 22:02:37.645550 tst mo_mt_sms.py: using LAC 17039 22:02:37.767325 tst mo_mt_sms.py: using RAC 209 22:02:37.888830 tst mo_mt_sms.py: using CellId 17039 22:02:38.010988 tst mo_mt_sms.py: using BVCI 17040 22:02:38.125137 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:38.136027 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:38.146870 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:38.157644 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:38.168310 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:38.179054 tst sms:trx-b200: Using 1 x modem (candidates: 2) 22:02:38.292755 tst sms:trx-b200: Using 1 x modem (candidates: 2) 22:02:38.410589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:02:38.898949 run create_hlr_db(pid=18978): Launched 22:02:39.026699 bus /sierra_2: Setting Powered False 22:02:40.089781 run create_hlr_db(pid=18978): Terminated: ok {rc=0} 22:02:40.512342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18980): Launched 22:02:40.807856 run osmo-hlr_10.42.42.2(pid=18981): Launched 22:02:40.920452 run osmo-stp_10.42.42.5: Starting osmo-stp 22:02:41.442195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18983): Launched 22:02:41.736605 run osmo-stp_10.42.42.5(pid=18984): Launched 22:02:41.848714 run osmo-msc_10.42.42.6: Starting osmo-msc 22:02:42.383945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18986): Launched 22:02:42.678462 run osmo-msc_10.42.42.6(pid=18987): Launched 22:02:42.842744 run osmo-stp_10.42.42.5(pid=18984): ERR: Terminated: ERROR {rc=1} [trial-2350↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18984)] 22:02:42.968278 run osmo-stp_10.42.42.5(pid=18984): stdout: | (launched: 2022-12-08_22:02:41.682933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:43.095002 run osmo-stp_10.42.42.5(pid=18984): stderr: | 20221208220241854 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220241854 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220241854 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220241854 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220241855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220241855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220241855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:43.219662 run osmo-stp_10.42.42.5(pid=18984): stdout: | (launched: 2022-12-08_22:02:41.682933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:43.338265 run osmo-stp_10.42.42.5(pid=18984): stderr: | 20221208220241854 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220241854 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220241854 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220241854 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220241855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220241855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220241855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:43.479609 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=18984): Process ended prematurely: osmo-stp_10.42.42.5(pid=18984) [trial-2350↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18984)] [trial-2350↪sms:trx-b200↪mo_mt_sms.py:16] 22:02:43.487831 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 22:02:43.514194 run osmo-hlr_10.42.42.2(pid=18981): ERR: Terminated: ERROR {rc=237} [trial-2350↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18981)] 22:02:43.563325 run osmo-hlr_10.42.42.2(pid=18981): stdout: | (launched: 2022-12-08_22:02:40.753652) 22:02:43.614123 run osmo-hlr_10.42.42.2(pid=18981): stderr: | 20221208220240927 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220240927 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220240927 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220240927 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220240927 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220240927 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220240940 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220240951 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220240951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220240951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:02:43.684609 run osmo-msc_10.42.42.6(pid=18987): ERR: Terminated: ERROR {rc=2} [trial-2350↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18987)] 22:02:43.733338 run osmo-msc_10.42.42.6(pid=18987): stdout: | (launched: 2022-12-08_22:02:42.624656) 22:02:43.783767 run osmo-msc_10.42.42.6(pid=18987): stderr: | 20221208220242895 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208220242895 DLGLOBAL DEBUG validating counter group 0x7f02d00f4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208220242895 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208220242895 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208220242895 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208220242895 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208220242897 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208220242898 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208220242898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208220242898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:02:43.834532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18980): Terminating (SIGTERM) 22:02:43.875077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18983): Terminating (SIGTERM) 22:02:43.915993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18986): Terminating (SIGTERM) 22:02:43.957173 --- ParallelTerminationStrategy: PID 18980 died... 22:02:43.976556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18980): Terminated: ok {rc=0} 22:02:44.022208 --- ParallelTerminationStrategy: PID 18983 died... 22:02:44.041102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18983): Terminated: ok {rc=0} 22:02:44.086506 --- ParallelTerminationStrategy: PID 18986 died... 22:02:44.105424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18986): Terminated: ok {rc=0} 22:02:44.192850 bus /sierra_3: Setting Powered False 22:02:45.291956 bus /sierra_3: Setting Powered False 22:02:46.421815 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 nitb_ussd:trx-b200 --------------------------------------------------------------------- 22:02:47.655937 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:02:47.659527 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 22:02:47.692296 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 22:02:47.698870 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 22:02:47.733935 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 22:02:47.766924 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 22:02:47.773487 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 22:02:48.291260 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2350 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 22:02:48.295985 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 22:02:48.306581 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 22:02:48.352887 tst assert_extension.py: using LAC 17040 22:02:48.469315 tst assert_extension.py: using RAC 210 22:02:48.591756 tst assert_extension.py: using CellId 17040 22:02:48.708639 tst assert_extension.py: using BVCI 17041 22:02:48.815993 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 22:02:48.926678 tst assert_extension.py:10: start nitb and bts... 22:02:49.124123 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:02:49.727328 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18992): Launched 22:02:50.020551 run osmo-nitb_10.42.42.2(pid=18993): Launched 22:02:50.184469 run osmo-nitb_10.42.42.2(pid=18993): ERR: Terminated: ERROR {rc=2} [trial-2350↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18993)] 22:02:50.318153 run osmo-nitb_10.42.42.2(pid=18993): stdout: | (launched: 2022-12-08_22:02:49.967405) 22:02:50.453441 run osmo-nitb_10.42.42.2(pid=18993): stderr: | (launched: 2022-12-08_22:02:50.011403) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:02:50.588601 run osmo-nitb_10.42.42.2(pid=18993): stdout: | (launched: 2022-12-08_22:02:49.967405) 22:02:50.718333 run osmo-nitb_10.42.42.2(pid=18993): stderr: | (launched: 2022-12-08_22:02:50.011403) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3c9519268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=18993): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18993) [trial-2350↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18993)] 22:02:51.132446 tst osmo-nitb_10.42.42.2(pid=18993): stdout: | (launched: 2022-12-08_22:02:49.967405) 22:02:51.251816 tst osmo-nitb_10.42.42.2(pid=18993): stderr: | (launched: 2022-12-08_22:02:50.011403) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:02:51.392784 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=18993): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18993) [trial-2350↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18993)] [trial-2350↪nitb_ussd:trx-b200↪assert_extension.py:12] 22:02:51.401207 tst assert_extension.py:12: Test FAILED (3.1 sec) 22:02:51.407658 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18992): Terminating (SIGTERM) 22:02:51.617769 --- ParallelTerminationStrategy: PID 18992 died... 22:02:51.639114 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18992): Terminated: ok {rc=0} 22:02:51.726648 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 ussd:trx-b200 --------------------------------------------------------------------- 22:02:52.909083 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:02:52.913221 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 22:02:52.946641 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 22:02:52.973725 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 22:02:53.007954 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 22:02:53.041036 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 22:02:53.067867 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 22:02:53.595967 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2350 ussd:trx-b200 assert_extension.py ---------------------------------------------- 22:02:53.601152 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:53.611649 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 22:02:53.662445 tst assert_extension.py: using LAC 17041 22:02:53.786076 tst assert_extension.py: using RAC 211 22:02:53.910356 tst assert_extension.py: using CellId 17041 22:02:54.032304 tst assert_extension.py: using BVCI 17042 22:02:54.149297 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:54.160110 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:54.170922 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:54.181673 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:54.192346 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:54.203125 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 22:02:54.316524 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:02:54.806058 run create_hlr_db(pid=18997): Launched 22:02:54.933852 bus /sierra_2: Setting Powered False 22:02:55.996424 run create_hlr_db(pid=18997): Terminated: ok {rc=0} 22:02:56.418868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18999): Launched 22:02:56.714056 run osmo-hlr_10.42.42.2(pid=19000): Launched 22:02:56.826341 run osmo-stp_10.42.42.5: Starting osmo-stp 22:02:57.346562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19002): Launched 22:02:57.641527 run osmo-stp_10.42.42.5(pid=19003): Launched 22:02:57.754419 run osmo-msc_10.42.42.6: Starting osmo-msc 22:02:58.289357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19005): Launched 22:02:58.585109 run osmo-msc_10.42.42.6(pid=19006): Launched 22:02:58.750273 run osmo-stp_10.42.42.5(pid=19003): ERR: Terminated: ERROR {rc=1} [trial-2350↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19003)] 22:02:58.876729 run osmo-stp_10.42.42.5(pid=19003): stdout: | (launched: 2022-12-08_22:02:57.588137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:59.003590 run osmo-stp_10.42.42.5(pid=19003): stderr: | 20221208220257756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220257756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220257756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220257757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220257759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220257759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220257759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:59.127881 run osmo-stp_10.42.42.5(pid=19003): stdout: | (launched: 2022-12-08_22:02:57.588137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:59.246063 run osmo-stp_10.42.42.5(pid=19003): stderr: | 20221208220257756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220257756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220257756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220257757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220257759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220257759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220257759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:59.388060 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=19003): Process ended prematurely: osmo-stp_10.42.42.5(pid=19003) [trial-2350↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19003)] [trial-2350↪ussd:trx-b200↪assert_extension.py:17] 22:02:59.396316 tst assert_extension.py:17: Test FAILED (5.8 sec) 22:02:59.423200 run osmo-hlr_10.42.42.2(pid=19000): ERR: Terminated: ERROR {rc=237} [trial-2350↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19000)] 22:02:59.472564 run osmo-hlr_10.42.42.2(pid=19000): stdout: | (launched: 2022-12-08_22:02:56.660731) 22:02:59.523900 run osmo-hlr_10.42.42.2(pid=19000): stderr: | 20221208220256835 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220256835 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220256835 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220256835 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220256836 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220256836 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220256849 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220256857 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220256857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220256857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:02:59.595032 run osmo-msc_10.42.42.6(pid=19006): ERR: Terminated: ERROR {rc=2} [trial-2350↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19006)] 22:02:59.644256 run osmo-msc_10.42.42.6(pid=19006): stdout: | (launched: 2022-12-08_22:02:58.531493) 22:02:59.695187 run osmo-msc_10.42.42.6(pid=19006): stderr: | 20221208220258804 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208220258804 DLGLOBAL DEBUG validating counter group 0x7f63b00fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208220258804 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208220258804 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208220258804 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208220258804 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208220258806 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208220258807 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208220258807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208220258807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:02:59.746547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18999): Terminating (SIGTERM) 22:02:59.787605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19002): Terminating (SIGTERM) 22:02:59.828602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19005): Terminating (SIGTERM) 22:02:59.869781 --- ParallelTerminationStrategy: PID 18999 died... 22:02:59.889174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18999): Terminated: ok {rc=0} 22:02:59.934670 --- ParallelTerminationStrategy: PID 19002 died... 22:02:59.953496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19002): Terminated: ok {rc=0} 22:02:59.998821 --- ParallelTerminationStrategy: PID 19005 died... 22:03:00.017637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19005): Terminated: ok {rc=0} 22:03:00.105670 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:03:01.318866 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:03:01.328558 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:03:01.370674 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:03:01.405454 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:03:01.460524 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:03:01.496226 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:03:01.523526 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:03:02.070138 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:03:02.123934 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:02.136107 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:03:02.213358 tst mo_mt_call.py: using LAC 17042 22:03:02.335331 tst mo_mt_call.py: using RAC 212 22:03:02.463405 tst mo_mt_call.py: using CellId 17042 22:03:02.590896 tst mo_mt_call.py: using BVCI 17043 22:03:02.709482 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:02.721348 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:02.732626 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:02.743856 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:02.755097 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:02.766340 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:03:02.880369 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:03:02.994128 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:03:03.462492 run create_hlr_db(pid=19012): Launched 22:03:03.578319 bus /sierra_2: Setting Powered False 22:03:04.639286 run create_hlr_db(pid=19012): Terminated: ok {rc=0} 22:03:05.079111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19014): Launched 22:03:05.400154 run osmo-hlr_10.42.42.2(pid=19015): Launched 22:03:05.523561 run osmo-stp_10.42.42.5: Starting osmo-stp 22:03:06.078608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19017): Launched 22:03:06.398632 run osmo-stp_10.42.42.5(pid=19018): Launched 22:03:06.521103 run osmo-msc_10.42.42.6: Starting osmo-msc 22:03:07.102500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19020): Launched 22:03:07.423568 run osmo-msc_10.42.42.6(pid=19021): Launched 22:03:07.604661 run osmo-stp_10.42.42.5(pid=19018): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19018)] 22:03:07.740801 run osmo-stp_10.42.42.5(pid=19018): stdout: | (launched: 2022-12-08_22:03:06.341102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:07.877397 run osmo-stp_10.42.42.5(pid=19018): stderr: | 20221208220306535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220306535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220306536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220306536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220306536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220306536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220306537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:08.013408 run osmo-stp_10.42.42.5(pid=19018): stdout: | (launched: 2022-12-08_22:03:06.341102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:08.141910 run osmo-stp_10.42.42.5(pid=19018): stderr: | 20221208220306535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220306535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220306536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220306536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220306536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220306536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220306537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:08.295613 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19018): Process ended prematurely: osmo-stp_10.42.42.5(pid=19018) [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19018)] [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:03:08.305420 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:03:08.333737 run osmo-hlr_10.42.42.2(pid=19015): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19015)] 22:03:08.385132 run osmo-hlr_10.42.42.2(pid=19015): stdout: | (launched: 2022-12-08_22:03:05.342283) 22:03:08.438098 run osmo-hlr_10.42.42.2(pid=19015): stderr: | 20221208220305541 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220305541 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220305541 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220305541 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220305541 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220305541 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220305554 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220305562 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220305562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220305562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:03:08.512036 run osmo-msc_10.42.42.6(pid=19021): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19021)] 22:03:08.563191 run osmo-msc_10.42.42.6(pid=19021): stdout: | (launched: 2022-12-08_22:03:07.365589) 22:03:08.615946 run osmo-msc_10.42.42.6(pid=19021): stderr: | 20221208220307690 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208220307690 DLGLOBAL DEBUG validating counter group 0x7fafeff3ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208220307690 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208220307691 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208220307691 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208220307691 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208220307692 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208220307693 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208220307693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208220307693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:03:08.669167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19014): Terminating (SIGTERM) 22:03:08.711683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19017): Terminating (SIGTERM) 22:03:08.754435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19020): Terminating (SIGTERM) 22:03:08.797142 --- ParallelTerminationStrategy: PID 19014 died... 22:03:08.817376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19014): Terminated: ok {rc=0} 22:03:08.864576 --- ParallelTerminationStrategy: PID 19017 died... 22:03:08.884481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19017): Terminated: ok {rc=0} 22:03:08.931559 --- ParallelTerminationStrategy: PID 19020 died... 22:03:08.951469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19020): Terminated: ok {rc=0} 22:03:09.039830 bus /sierra_3: Setting Powered False 22:03:10.140255 bus /sierra_3: Setting Powered False 22:03:11.259123 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:03:12.406072 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:12.417617 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:03:12.487004 tst mo_mt_call_osmux.py: using LAC 17043 22:03:12.607211 tst mo_mt_call_osmux.py: using RAC 213 22:03:12.732772 tst mo_mt_call_osmux.py: using CellId 17043 22:03:12.852667 tst mo_mt_call_osmux.py: using BVCI 17044 22:03:12.970829 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:12.982508 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:12.994077 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:13.005632 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:13.017293 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:13.028574 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:03:13.142154 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:03:13.258761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:03:13.758354 run create_hlr_db(pid=19023): Launched 22:03:13.889238 bus /sierra_2: Setting Powered False 22:03:14.953499 run create_hlr_db(pid=19023): Terminated: ok {rc=0} 22:03:15.383903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19025): Launched 22:03:15.685568 run osmo-hlr_10.42.42.2(pid=19026): Launched 22:03:15.800682 run osmo-stp_10.42.42.5: Starting osmo-stp 22:03:16.418445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19028): Launched 22:03:16.762274 run osmo-stp_10.42.42.5(pid=19029): Launched 22:03:17.011982 run osmo-msc_10.42.42.6: Starting osmo-msc 22:03:17.648203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19031): Launched 22:03:17.968730 run osmo-msc_10.42.42.6(pid=19032): Launched 22:03:18.146739 run osmo-stp_10.42.42.5(pid=19029): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19029)] 22:03:18.282099 run osmo-stp_10.42.42.5(pid=19029): stdout: | (launched: 2022-12-08_22:03:16.702055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:18.417482 run osmo-stp_10.42.42.5(pid=19029): stderr: | 20221208220316996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220316996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220316996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220316997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220316999 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220316999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220316999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:18.553356 run osmo-stp_10.42.42.5(pid=19029): stdout: | (launched: 2022-12-08_22:03:16.702055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:18.681842 run osmo-stp_10.42.42.5(pid=19029): stderr: | 20221208220316996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220316996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220316996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220316997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220316999 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220316999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220316999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:18.834801 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19029): Process ended prematurely: osmo-stp_10.42.42.5(pid=19029) [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19029)] [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:03:18.844365 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 22:03:18.872575 run osmo-hlr_10.42.42.2(pid=19026): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19026)] 22:03:18.923683 run osmo-hlr_10.42.42.2(pid=19026): stdout: | (launched: 2022-12-08_22:03:15.631161) 22:03:18.976829 run osmo-hlr_10.42.42.2(pid=19026): stderr: | 20221208220315807 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220315807 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220315807 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220315807 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220315807 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220315807 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220315819 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220315843 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220315843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220315843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:03:19.050658 run osmo-msc_10.42.42.6(pid=19032): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19032)] 22:03:19.101813 run osmo-msc_10.42.42.6(pid=19032): stdout: | (launched: 2022-12-08_22:03:17.911187) 22:03:19.154415 run osmo-msc_10.42.42.6(pid=19032): stderr: | 20221208220318231 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208220318231 DLGLOBAL DEBUG validating counter group 0x7fa8ed761c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208220318232 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208220318232 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208220318232 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208220318232 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208220318234 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208220318234 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208220318234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208220318234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:03:19.207270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19025): Terminating (SIGTERM) 22:03:19.249723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19028): Terminating (SIGTERM) 22:03:19.292387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19031): Terminating (SIGTERM) 22:03:19.335408 --- ParallelTerminationStrategy: PID 19025 died... 22:03:19.355647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19025): Terminated: ok {rc=0} 22:03:19.403104 --- ParallelTerminationStrategy: PID 19028 died... 22:03:19.422983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19028): Terminated: ok {rc=0} 22:03:19.469909 --- ParallelTerminationStrategy: PID 19031 died... 22:03:19.490058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19031): Terminated: ok {rc=0} 22:03:19.579623 bus /sierra_3: Setting Powered False 22:03:20.680084 bus /sierra_3: Setting Powered False 22:03:21.798781 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:03:23.045491 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:03:23.051724 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:03:23.084681 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:03:23.110660 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:03:23.161971 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:03:23.195097 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:03:23.221544 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:03:23.770208 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:03:23.818880 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:23.829825 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:03:23.897624 tst mo_mt_call.py: using LAC 17044 22:03:24.018768 tst mo_mt_call.py: using RAC 214 22:03:24.142519 tst mo_mt_call.py: using CellId 17044 22:03:24.262207 tst mo_mt_call.py: using BVCI 17045 22:03:24.373476 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:24.384340 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:24.395218 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:24.406150 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:24.417215 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:24.428486 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:03:24.547488 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:03:24.665112 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:03:25.130131 run create_hlr_db(pid=19037): Launched 22:03:25.245304 bus /sierra_2: Setting Powered False 22:03:26.306374 run create_hlr_db(pid=19037): Terminated: ok {rc=0} 22:03:26.725702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19039): Launched 22:03:27.027028 run osmo-hlr_10.42.42.2(pid=19040): Launched 22:03:27.142200 run osmo-stp_10.42.42.5: Starting osmo-stp 22:03:27.674247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19042): Launched 22:03:27.973629 run osmo-stp_10.42.42.5(pid=19043): Launched 22:03:28.088637 run osmo-msc_10.42.42.6: Starting osmo-msc 22:03:28.636884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19045): Launched 22:03:28.937355 run osmo-msc_10.42.42.6(pid=19046): Launched 22:03:29.106741 run osmo-stp_10.42.42.5(pid=19043): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19043)] 22:03:29.236340 run osmo-stp_10.42.42.5(pid=19043): stdout: | (launched: 2022-12-08_22:03:27.919111) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:29.365860 run osmo-stp_10.42.42.5(pid=19043): stderr: | 20221208220328089 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220328089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220328089 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220328089 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220328090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220328090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220328090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:29.492623 run osmo-stp_10.42.42.5(pid=19043): stdout: | (launched: 2022-12-08_22:03:27.919111) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:29.613935 run osmo-stp_10.42.42.5(pid=19043): stderr: | 20221208220328089 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220328089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220328089 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220328089 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220328090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220328090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220328090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:29.758452 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19043): Process ended prematurely: osmo-stp_10.42.42.5(pid=19043) [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19043)] [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:03:29.767199 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:03:29.794429 run osmo-hlr_10.42.42.2(pid=19040): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19040)] 22:03:29.843798 run osmo-hlr_10.42.42.2(pid=19040): stdout: | (launched: 2022-12-08_22:03:26.972197) 22:03:29.894667 run osmo-hlr_10.42.42.2(pid=19040): stderr: | 20221208220327149 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220327149 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220327149 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220327149 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220327149 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220327149 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220327160 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220327169 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220327169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220327169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:03:29.965536 run osmo-msc_10.42.42.6(pid=19046): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19046)] 22:03:30.014476 run osmo-msc_10.42.42.6(pid=19046): stdout: | (launched: 2022-12-08_22:03:28.882612) 22:03:30.065165 run osmo-msc_10.42.42.6(pid=19046): stderr: | 20221208220329151 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208220329151 DLGLOBAL DEBUG validating counter group 0x7fe1a73e3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208220329151 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208220329151 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208220329152 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208220329152 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208220329154 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208220329154 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208220329154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208220329154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:03:30.116270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19039): Terminating (SIGTERM) 22:03:30.156766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19042): Terminating (SIGTERM) 22:03:30.198115 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19045): Terminating (SIGTERM) 22:03:30.239095 --- ParallelTerminationStrategy: PID 19039 died... 22:03:30.258464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19039): Terminated: ok {rc=0} 22:03:30.303992 --- ParallelTerminationStrategy: PID 19042 died... 22:03:30.322936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19042): Terminated: ok {rc=0} 22:03:30.368078 --- ParallelTerminationStrategy: PID 19045 died... 22:03:30.387223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19045): Terminated: ok {rc=0} 22:03:30.472322 bus /sierra_3: Setting Powered False 22:03:31.571020 bus /sierra_3: Setting Powered False 22:03:32.691679 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:03:33.841892 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:33.856576 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:03:33.925383 tst mo_mt_call_osmux.py: using LAC 17045 22:03:34.045619 tst mo_mt_call_osmux.py: using RAC 215 22:03:34.173056 tst mo_mt_call_osmux.py: using CellId 17045 22:03:34.301425 tst mo_mt_call_osmux.py: using BVCI 17046 22:03:34.420584 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:34.432208 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:34.443645 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:34.455309 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:34.467061 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:34.478503 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:03:34.597213 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:03:34.717687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:03:35.214002 run create_hlr_db(pid=19048): Launched 22:03:35.344049 bus /sierra_2: Setting Powered False 22:03:36.408437 run create_hlr_db(pid=19048): Terminated: ok {rc=0} 22:03:36.839326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19050): Launched 22:03:37.141360 run osmo-hlr_10.42.42.2(pid=19051): Launched 22:03:37.256585 run osmo-stp_10.42.42.5: Starting osmo-stp 22:03:37.781919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19053): Launched 22:03:38.082256 run osmo-stp_10.42.42.5(pid=19054): Launched 22:03:38.197059 run osmo-msc_10.42.42.6: Starting osmo-msc 22:03:38.745389 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19056): Launched 22:03:39.048292 run osmo-msc_10.42.42.6(pid=19057): Launched 22:03:39.217444 run osmo-stp_10.42.42.5(pid=19054): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19054)] 22:03:39.346988 run osmo-stp_10.42.42.5(pid=19054): stdout: | (launched: 2022-12-08_22:03:38.027893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:39.476333 run osmo-stp_10.42.42.5(pid=19054): stderr: | 20221208220338197 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220338198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220338198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220338198 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220338199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220338199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220338199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:39.602958 run osmo-stp_10.42.42.5(pid=19054): stdout: | (launched: 2022-12-08_22:03:38.027893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:39.723813 run osmo-stp_10.42.42.5(pid=19054): stderr: | 20221208220338197 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220338198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220338198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220338198 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220338199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220338199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220338199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:39.867651 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19054): Process ended prematurely: osmo-stp_10.42.42.5(pid=19054) [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19054)] [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:03:39.876847 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:03:39.903757 run osmo-hlr_10.42.42.2(pid=19051): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19051)] 22:03:39.953289 run osmo-hlr_10.42.42.2(pid=19051): stdout: | (launched: 2022-12-08_22:03:37.086674) 22:03:40.003818 run osmo-hlr_10.42.42.2(pid=19051): stderr: | 20221208220337259 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220337259 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220337259 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220337259 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220337259 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220337259 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220337271 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220337280 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220337280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220337280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:03:40.074290 run osmo-msc_10.42.42.6(pid=19057): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19057)] 22:03:40.123182 run osmo-msc_10.42.42.6(pid=19057): stdout: | (launched: 2022-12-08_22:03:38.993848) 22:03:40.173889 run osmo-msc_10.42.42.6(pid=19057): stderr: | 20221208220339264 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208220339264 DLGLOBAL DEBUG validating counter group 0x7f86ebd1bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208220339264 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208220339264 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208220339265 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208220339265 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208220339266 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208220339267 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208220339267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208220339267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:03:40.225613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19050): Terminating (SIGTERM) 22:03:40.266237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19053): Terminating (SIGTERM) 22:03:40.306837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19056): Terminating (SIGTERM) 22:03:40.347723 --- ParallelTerminationStrategy: PID 19050 died... 22:03:40.366881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19050): Terminated: ok {rc=0} 22:03:40.412291 --- ParallelTerminationStrategy: PID 19053 died... 22:03:40.431009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19053): Terminated: ok {rc=0} 22:03:40.476560 --- ParallelTerminationStrategy: PID 19056 died... 22:03:40.495369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19056): Terminated: ok {rc=0} 22:03:40.582695 bus /sierra_3: Setting Powered False 22:03:41.684364 bus /sierra_3: Setting Powered False 22:03:42.798635 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:03:44.041393 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:03:44.047825 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:03:44.080868 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:03:44.106907 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:03:44.159357 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:03:44.193115 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:03:44.219270 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:03:44.765960 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:03:44.814891 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:44.826081 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:03:44.894259 tst mo_mt_call.py: using LAC 17046 22:03:45.014246 tst mo_mt_call.py: using RAC 216 22:03:45.135307 tst mo_mt_call.py: using CellId 17046 22:03:45.255569 tst mo_mt_call.py: using BVCI 17047 22:03:45.367475 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:45.378484 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:45.389360 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:45.400200 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:45.411186 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:45.422443 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:03:45.540027 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:03:45.655228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:03:46.223424 run create_hlr_db(pid=19062): Launched 22:03:46.406047 bus /sierra_2: Setting Powered False 22:03:47.469729 run create_hlr_db(pid=19062): Terminated: ok {rc=0} 22:03:47.911421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19064): Launched 22:03:48.212493 run osmo-hlr_10.42.42.2(pid=19065): Launched 22:03:48.327174 run osmo-stp_10.42.42.5: Starting osmo-stp 22:03:48.854179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19067): Launched 22:03:49.154559 run osmo-stp_10.42.42.5(pid=19068): Launched 22:03:49.268911 run osmo-msc_10.42.42.6: Starting osmo-msc 22:03:49.813950 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19070): Launched 22:03:50.114698 run osmo-msc_10.42.42.6(pid=19071): Launched 22:03:50.283313 run osmo-stp_10.42.42.5(pid=19068): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19068)] 22:03:50.411888 run osmo-stp_10.42.42.5(pid=19068): stdout: | (launched: 2022-12-08_22:03:49.099862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:50.540555 run osmo-stp_10.42.42.5(pid=19068): stderr: | 20221208220349268 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220349268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220349269 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220349269 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220349269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220349270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220349270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:50.667314 run osmo-stp_10.42.42.5(pid=19068): stdout: | (launched: 2022-12-08_22:03:49.099862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:50.787519 run osmo-stp_10.42.42.5(pid=19068): stderr: | 20221208220349268 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220349268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220349269 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220349269 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220349269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220349270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220349270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:50.931881 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19068): Process ended prematurely: osmo-stp_10.42.42.5(pid=19068) [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19068)] [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:03:50.940688 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:03:50.967954 run osmo-hlr_10.42.42.2(pid=19065): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19065)] 22:03:51.016808 run osmo-hlr_10.42.42.2(pid=19065): stdout: | (launched: 2022-12-08_22:03:48.157788) 22:03:51.067412 run osmo-hlr_10.42.42.2(pid=19065): stderr: | 20221208220348333 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220348333 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220348333 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220348333 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220348333 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220348333 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220348344 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220348353 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220348354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220348354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:03:51.137587 run osmo-msc_10.42.42.6(pid=19071): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19071)] 22:03:51.186428 run osmo-msc_10.42.42.6(pid=19071): stdout: | (launched: 2022-12-08_22:03:50.059804) 22:03:51.236743 run osmo-msc_10.42.42.6(pid=19071): stderr: | 20221208220350331 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208220350331 DLGLOBAL DEBUG validating counter group 0x7f23f3423c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208220350331 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208220350331 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208220350331 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208220350331 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208220350333 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208220350334 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208220350334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208220350334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:03:51.287421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19064): Terminating (SIGTERM) 22:03:51.328117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19067): Terminating (SIGTERM) 22:03:51.368544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19070): Terminating (SIGTERM) 22:03:51.409184 --- ParallelTerminationStrategy: PID 19064 died... 22:03:51.428322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19064): Terminated: ok {rc=0} 22:03:51.473704 --- ParallelTerminationStrategy: PID 19067 died... 22:03:51.492613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19067): Terminated: ok {rc=0} 22:03:51.538061 --- ParallelTerminationStrategy: PID 19070 died... 22:03:51.557037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19070): Terminated: ok {rc=0} 22:03:51.645429 bus /sierra_3: Setting Powered False 22:03:52.747144 bus /sierra_3: Setting Powered False 22:03:53.860880 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:03:55.011432 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:55.023498 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:03:55.095741 tst mo_mt_call_osmux.py: using LAC 17047 22:03:55.222546 tst mo_mt_call_osmux.py: using RAC 217 22:03:55.350204 tst mo_mt_call_osmux.py: using CellId 17047 22:03:55.476534 tst mo_mt_call_osmux.py: using BVCI 17048 22:03:55.594251 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:55.605720 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:55.616854 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:55.628110 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:55.639391 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:55.650672 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:03:55.765115 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:03:55.880672 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:03:56.380421 run create_hlr_db(pid=19073): Launched 22:03:56.510774 bus /sierra_2: Setting Powered False 22:03:57.575675 run create_hlr_db(pid=19073): Terminated: ok {rc=0} 22:03:58.006620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19075): Launched 22:03:58.307281 run osmo-hlr_10.42.42.2(pid=19076): Launched 22:03:58.421443 run osmo-stp_10.42.42.5: Starting osmo-stp 22:03:58.950854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19078): Launched 22:03:59.250432 run osmo-stp_10.42.42.5(pid=19079): Launched 22:03:59.365114 run osmo-msc_10.42.42.6: Starting osmo-msc 22:03:59.909783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19081): Launched 22:04:00.212604 run osmo-msc_10.42.42.6(pid=19082): Launched 22:04:00.381632 run osmo-stp_10.42.42.5(pid=19079): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19079)] 22:04:00.510487 run osmo-stp_10.42.42.5(pid=19079): stdout: | (launched: 2022-12-08_22:03:59.196374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:00.639338 run osmo-stp_10.42.42.5(pid=19079): stderr: | 20221208220359367 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220359367 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220359367 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220359368 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220359368 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220359368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220359368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:00.765787 run osmo-stp_10.42.42.5(pid=19079): stdout: | (launched: 2022-12-08_22:03:59.196374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:00.902264 run osmo-stp_10.42.42.5(pid=19079): stderr: | 20221208220359367 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220359367 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220359367 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220359368 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220359368 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220359368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220359368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:01.052936 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19079): Process ended prematurely: osmo-stp_10.42.42.5(pid=19079) [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19079)] [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:04:01.062448 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:04:01.090104 run osmo-hlr_10.42.42.2(pid=19076): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19076)] 22:04:01.140179 run osmo-hlr_10.42.42.2(pid=19076): stdout: | (launched: 2022-12-08_22:03:58.252748) 22:04:01.191523 run osmo-hlr_10.42.42.2(pid=19076): stderr: | 20221208220358430 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220358430 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220358430 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220358430 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220358430 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220358430 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220358443 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220358454 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220358454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220358454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:04:01.263414 run osmo-msc_10.42.42.6(pid=19082): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19082)] 22:04:01.313369 run osmo-msc_10.42.42.6(pid=19082): stdout: | (launched: 2022-12-08_22:04:00.157187) 22:04:01.366408 run osmo-msc_10.42.42.6(pid=19082): stderr: | 20221208220400427 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208220400427 DLGLOBAL DEBUG validating counter group 0x7fbec5f17c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208220400427 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208220400427 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208220400428 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208220400428 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208220400430 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208220400430 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208220400430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208220400430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:04:01.419558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19075): Terminating (SIGTERM) 22:04:01.462734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19078): Terminating (SIGTERM) 22:04:01.507108 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19081): Terminating (SIGTERM) 22:04:01.550399 --- ParallelTerminationStrategy: PID 19075 died... 22:04:01.570367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19075): Terminated: ok {rc=0} 22:04:01.618848 --- ParallelTerminationStrategy: PID 19078 died... 22:04:01.638819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19078): Terminated: ok {rc=0} 22:04:01.686898 --- ParallelTerminationStrategy: PID 19081 died... 22:04:01.708339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19081): Terminated: ok {rc=0} 22:04:01.797903 bus /sierra_3: Setting Powered False 22:04:02.895226 bus /sierra_3: Setting Powered False 22:04:04.012218 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 22:04:05.258223 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:04:05.264639 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 22:04:05.298260 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 22:04:05.324873 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 22:04:05.375781 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 22:04:05.408521 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 22:04:05.435130 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 22:04:05.984065 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 22:04:06.033294 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:06.044423 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:04:06.112753 tst mo_mt_call.py: using LAC 17048 22:04:06.231714 tst mo_mt_call.py: using RAC 218 22:04:06.351080 tst mo_mt_call.py: using CellId 17048 22:04:06.474700 tst mo_mt_call.py: using BVCI 17049 22:04:06.586938 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:06.598106 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:06.609074 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:06.620346 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:06.631754 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:06.643144 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:04:06.756008 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:04:06.870181 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:04:07.335671 run create_hlr_db(pid=19087): Launched 22:04:07.451364 bus /sierra_2: Setting Powered False 22:04:08.511326 run create_hlr_db(pid=19087): Terminated: ok {rc=0} 22:04:08.931924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19089): Launched 22:04:09.233238 run osmo-hlr_10.42.42.2(pid=19090): Launched 22:04:09.348182 run osmo-stp_10.42.42.5: Starting osmo-stp 22:04:09.878417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19092): Launched 22:04:10.179108 run osmo-stp_10.42.42.5(pid=19093): Launched 22:04:10.293971 run osmo-msc_10.42.42.6: Starting osmo-msc 22:04:10.841742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19095): Launched 22:04:11.141891 run osmo-msc_10.42.42.6(pid=19096): Launched 22:04:11.310344 run osmo-stp_10.42.42.5(pid=19093): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19093)] 22:04:11.439420 run osmo-stp_10.42.42.5(pid=19093): stdout: | (launched: 2022-12-08_22:04:10.124870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:11.568005 run osmo-stp_10.42.42.5(pid=19093): stderr: | 20221208220410295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220410295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220410295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220410296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220410296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220410296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220410296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:11.694482 run osmo-stp_10.42.42.5(pid=19093): stdout: | (launched: 2022-12-08_22:04:10.124870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:11.815393 run osmo-stp_10.42.42.5(pid=19093): stderr: | 20221208220410295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220410295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220410295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220410296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220410296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220410296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220410296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:11.983637 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19093): Process ended prematurely: osmo-stp_10.42.42.5(pid=19093) [trial-2350↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19093)] [trial-2350↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 22:04:11.992709 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:04:12.020068 run osmo-hlr_10.42.42.2(pid=19090): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19090)] 22:04:12.069127 run osmo-hlr_10.42.42.2(pid=19090): stdout: | (launched: 2022-12-08_22:04:09.178782) 22:04:12.119773 run osmo-hlr_10.42.42.2(pid=19090): stderr: | 20221208220409356 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220409356 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220409356 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220409356 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220409356 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220409356 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220409368 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220409376 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220409377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220409377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:04:12.189923 run osmo-msc_10.42.42.6(pid=19096): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19096)] 22:04:12.238553 run osmo-msc_10.42.42.6(pid=19096): stdout: | (launched: 2022-12-08_22:04:11.087510) 22:04:12.289190 run osmo-msc_10.42.42.6(pid=19096): stderr: | 20221208220411358 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208220411359 DLGLOBAL DEBUG validating counter group 0x7f4df080cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208220411359 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208220411359 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208220411359 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208220411359 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208220411361 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208220411361 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208220411362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208220411362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:04:12.339894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19089): Terminating (SIGTERM) 22:04:12.380423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19092): Terminating (SIGTERM) 22:04:12.421047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19095): Terminating (SIGTERM) 22:04:12.461815 --- ParallelTerminationStrategy: PID 19089 died... 22:04:12.481094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19089): Terminated: ok {rc=0} 22:04:12.526437 --- ParallelTerminationStrategy: PID 19092 died... 22:04:12.545530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19092): Terminated: ok {rc=0} 22:04:12.591017 --- ParallelTerminationStrategy: PID 19095 died... 22:04:12.610052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19095): Terminated: ok {rc=0} 22:04:12.695070 bus /sierra_3: Setting Powered False 22:04:13.794088 bus /sierra_3: Setting Powered False 22:04:14.911677 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 22:04:16.062278 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:16.075453 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:04:16.146848 tst mo_mt_call_osmux.py: using LAC 17049 22:04:16.309640 tst mo_mt_call_osmux.py: using RAC 219 22:04:16.435150 tst mo_mt_call_osmux.py: using CellId 17049 22:04:16.587755 tst mo_mt_call_osmux.py: using BVCI 17050 22:04:16.702443 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:16.714512 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:16.726375 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:16.738894 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:16.753218 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:16.765164 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:04:16.886198 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:04:17.020620 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:04:17.527085 run create_hlr_db(pid=19098): Launched 22:04:17.658542 bus /sierra_2: Setting Powered False 22:04:18.722641 run create_hlr_db(pid=19098): Terminated: ok {rc=0} 22:04:19.169549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19100): Launched 22:04:19.491298 run osmo-hlr_10.42.42.2(pid=19101): Launched 22:04:19.614259 run osmo-stp_10.42.42.5: Starting osmo-stp 22:04:20.172511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19103): Launched 22:04:20.493519 run osmo-stp_10.42.42.5(pid=19104): Launched 22:04:20.617161 run osmo-msc_10.42.42.6: Starting osmo-msc 22:04:21.200279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19106): Launched 22:04:21.521333 run osmo-msc_10.42.42.6(pid=19107): Launched 22:04:21.700270 run osmo-stp_10.42.42.5(pid=19104): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19104)] 22:04:21.836721 run osmo-stp_10.42.42.5(pid=19104): stdout: | (launched: 2022-12-08_22:04:20.435745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:21.973839 run osmo-stp_10.42.42.5(pid=19104): stderr: | 20221208220420625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220420625 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220420626 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220420626 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220420626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220420627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220420627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:22.110598 run osmo-stp_10.42.42.5(pid=19104): stdout: | (launched: 2022-12-08_22:04:20.435745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:22.239476 run osmo-stp_10.42.42.5(pid=19104): stderr: | 20221208220420625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220420625 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220420626 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220420626 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220420626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220420627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220420627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:22.393014 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19104): Process ended prematurely: osmo-stp_10.42.42.5(pid=19104) [trial-2350↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19104)] [trial-2350↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 22:04:22.402781 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 22:04:22.431154 run osmo-hlr_10.42.42.2(pid=19101): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19101)] 22:04:22.482433 run osmo-hlr_10.42.42.2(pid=19101): stdout: | (launched: 2022-12-08_22:04:19.433481) 22:04:22.536155 run osmo-hlr_10.42.42.2(pid=19101): stderr: | 20221208220419631 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220419631 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220419631 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220419631 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220419631 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220419631 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220419643 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220419651 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220419652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220419652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:04:22.610535 run osmo-msc_10.42.42.6(pid=19107): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19107)] 22:04:22.661803 run osmo-msc_10.42.42.6(pid=19107): stdout: | (launched: 2022-12-08_22:04:21.463283) 22:04:22.714958 run osmo-msc_10.42.42.6(pid=19107): stderr: | 20221208220421784 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208220421784 DLGLOBAL DEBUG validating counter group 0x7f2f98e62c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208220421784 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208220421784 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208220421784 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208220421784 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208220421786 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208220421786 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208220421787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208220421787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:04:22.768351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19100): Terminating (SIGTERM) 22:04:22.811226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19103): Terminating (SIGTERM) 22:04:22.854220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19106): Terminating (SIGTERM) 22:04:22.897561 --- ParallelTerminationStrategy: PID 19100 died... 22:04:22.918059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19100): Terminated: ok {rc=0} 22:04:22.965632 --- ParallelTerminationStrategy: PID 19103 died... 22:04:22.985643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19103): Terminated: ok {rc=0} 22:04:23.033053 --- ParallelTerminationStrategy: PID 19106 died... 22:04:23.053328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19106): Terminated: ok {rc=0} 22:04:23.142895 bus /sierra_3: Setting Powered False 22:04:24.244137 bus /sierra_3: Setting Powered False 22:04:25.363569 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:04:26.611475 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:04:26.617876 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:04:26.651589 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:04:26.677952 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:04:26.730844 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:04:26.765121 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:04:26.791171 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:04:27.343149 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:04:27.394668 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:27.405772 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:04:27.475376 tst mo_mt_call.py: using LAC 17050 22:04:27.602589 tst mo_mt_call.py: using RAC 220 22:04:27.728050 tst mo_mt_call.py: using CellId 17050 22:04:27.853323 tst mo_mt_call.py: using BVCI 17051 22:04:27.970445 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:27.981863 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:27.993093 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:28.004264 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:28.015549 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:28.026883 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:04:28.145469 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:04:28.264822 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:04:28.762490 run create_hlr_db(pid=19112): Launched 22:04:28.893302 bus /sierra_2: Setting Powered False 22:04:29.957582 run create_hlr_db(pid=19112): Terminated: ok {rc=0} 22:04:30.389725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19115): Launched 22:04:30.692507 run osmo-hlr_10.42.42.2(pid=19116): Launched 22:04:30.806880 run osmo-stp_10.42.42.5: Starting osmo-stp 22:04:31.450903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19118): Launched 22:04:31.797699 run osmo-stp_10.42.42.5(pid=19119): Launched 22:04:32.026229 run osmo-msc_10.42.42.6: Starting osmo-msc 22:04:32.667424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19121): Launched 22:04:32.987540 run osmo-msc_10.42.42.6(pid=19122): Launched 22:04:33.166102 run osmo-stp_10.42.42.5(pid=19119): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19119)] 22:04:33.301575 run osmo-stp_10.42.42.5(pid=19119): stdout: | (launched: 2022-12-08_22:04:31.733869) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:33.438109 run osmo-stp_10.42.42.5(pid=19119): stderr: | 20221208220431971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220431971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220431971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220431972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220431972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220431972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220431972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:33.573959 run osmo-stp_10.42.42.5(pid=19119): stdout: | (launched: 2022-12-08_22:04:31.733869) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:33.701987 run osmo-stp_10.42.42.5(pid=19119): stderr: | 20221208220431971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220431971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220431971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220431972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220431972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220431972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220431972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:33.855175 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19119): Process ended prematurely: osmo-stp_10.42.42.5(pid=19119) [trial-2350↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19119)] [trial-2350↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:04:33.864625 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 22:04:33.892699 run osmo-hlr_10.42.42.2(pid=19116): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19116)] 22:04:33.943520 run osmo-hlr_10.42.42.2(pid=19116): stdout: | (launched: 2022-12-08_22:04:30.637792) 22:04:33.996144 run osmo-hlr_10.42.42.2(pid=19116): stderr: | 20221208220430813 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220430813 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220430813 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220430813 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220430813 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220430813 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220430834 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220430855 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220430855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220430855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:04:34.069301 run osmo-msc_10.42.42.6(pid=19122): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19122)] 22:04:34.120567 run osmo-msc_10.42.42.6(pid=19122): stdout: | (launched: 2022-12-08_22:04:32.929832) 22:04:34.173240 run osmo-msc_10.42.42.6(pid=19122): stderr: | 20221208220433251 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208220433251 DLGLOBAL DEBUG validating counter group 0x7fb4068f8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208220433251 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208220433251 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208220433251 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208220433251 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208220433253 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208220433253 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208220433254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208220433254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:04:34.226006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19115): Terminating (SIGTERM) 22:04:34.268274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19118): Terminating (SIGTERM) 22:04:34.310777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19121): Terminating (SIGTERM) 22:04:34.353437 --- ParallelTerminationStrategy: PID 19115 died... 22:04:34.373586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19115): Terminated: ok {rc=0} 22:04:34.420266 --- ParallelTerminationStrategy: PID 19118 died... 22:04:34.439994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19118): Terminated: ok {rc=0} 22:04:34.486939 --- ParallelTerminationStrategy: PID 19121 died... 22:04:34.506775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19121): Terminated: ok {rc=0} 22:04:34.595402 bus /sierra_3: Setting Powered False 22:04:35.697204 bus /sierra_3: Setting Powered False 22:04:36.814234 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:04:37.963807 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:37.975792 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:04:38.047410 tst mo_mt_call_osmux.py: using LAC 17051 22:04:38.175925 tst mo_mt_call_osmux.py: using RAC 221 22:04:38.304241 tst mo_mt_call_osmux.py: using CellId 17051 22:04:38.430849 tst mo_mt_call_osmux.py: using BVCI 17052 22:04:38.549591 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:38.561401 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:38.572693 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:38.584008 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:38.595347 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:38.606568 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:04:38.721550 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:04:38.839478 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:04:39.338179 run create_hlr_db(pid=19124): Launched 22:04:39.468187 bus /sierra_2: Setting Powered False 22:04:40.532828 run create_hlr_db(pid=19124): Terminated: ok {rc=0} 22:04:40.963012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19126): Launched 22:04:41.264415 run osmo-hlr_10.42.42.2(pid=19127): Launched 22:04:41.379562 run osmo-stp_10.42.42.5: Starting osmo-stp 22:04:41.910765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19129): Launched 22:04:42.212835 run osmo-stp_10.42.42.5(pid=19130): Launched 22:04:42.327748 run osmo-msc_10.42.42.6: Starting osmo-msc 22:04:42.873628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19132): Launched 22:04:43.176184 run osmo-msc_10.42.42.6(pid=19133): Launched 22:04:43.345629 run osmo-stp_10.42.42.5(pid=19130): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19130)] 22:04:43.474860 run osmo-stp_10.42.42.5(pid=19130): stdout: | (launched: 2022-12-08_22:04:42.158241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:43.603987 run osmo-stp_10.42.42.5(pid=19130): stderr: | 20221208220442327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220442327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220442328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220442328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220442330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220442331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220442331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:43.731030 run osmo-stp_10.42.42.5(pid=19130): stdout: | (launched: 2022-12-08_22:04:42.158241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:43.851780 run osmo-stp_10.42.42.5(pid=19130): stderr: | 20221208220442327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220442327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220442328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220442328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220442330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220442331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220442331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:43.996212 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19130): Process ended prematurely: osmo-stp_10.42.42.5(pid=19130) [trial-2350↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19130)] [trial-2350↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:04:44.005272 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:04:44.032216 run osmo-hlr_10.42.42.2(pid=19127): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19127)] 22:04:44.081310 run osmo-hlr_10.42.42.2(pid=19127): stdout: | (launched: 2022-12-08_22:04:41.209849) 22:04:44.132059 run osmo-hlr_10.42.42.2(pid=19127): stderr: | 20221208220441388 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220441388 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220441388 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220441388 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220441388 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220441388 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220441400 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220441409 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220441409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220441409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:04:44.202714 run osmo-msc_10.42.42.6(pid=19133): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19133)] 22:04:44.251368 run osmo-msc_10.42.42.6(pid=19133): stdout: | (launched: 2022-12-08_22:04:43.121537) 22:04:44.301666 run osmo-msc_10.42.42.6(pid=19133): stderr: | 20221208220443392 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208220443392 DLGLOBAL DEBUG validating counter group 0x7f526438bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208220443393 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208220443393 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208220443393 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208220443393 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208220443395 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208220443395 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208220443395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208220443395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:04:44.352276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19126): Terminating (SIGTERM) 22:04:44.392691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19129): Terminating (SIGTERM) 22:04:44.433297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19132): Terminating (SIGTERM) 22:04:44.473991 --- ParallelTerminationStrategy: PID 19126 died... 22:04:44.493393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19126): Terminated: ok {rc=0} 22:04:44.538590 --- ParallelTerminationStrategy: PID 19129 died... 22:04:44.557494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19129): Terminated: ok {rc=0} 22:04:44.602438 --- ParallelTerminationStrategy: PID 19132 died... 22:04:44.621420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19132): Terminated: ok {rc=0} 22:04:44.707288 bus /sierra_3: Setting Powered False 22:04:45.806342 bus /sierra_3: Setting Powered False 22:04:46.943692 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:04:48.196499 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:04:48.203685 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:04:48.237353 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:04:48.264502 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:04:48.317639 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:04:48.351546 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:04:48.378473 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:04:48.933810 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:04:48.985100 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:04:48.996650 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:04:49.070755 tst mo_mt_call.py: using LAC 17052 22:04:49.197494 tst mo_mt_call.py: using RAC 222 22:04:49.329682 tst mo_mt_call.py: using CellId 17052 22:04:49.457469 tst mo_mt_call.py: using BVCI 17053 22:04:49.575773 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:04:49.587341 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:04:49.598634 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:04:49.609978 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:04:49.621254 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:04:49.632364 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:04:49.748379 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:04:49.863289 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:04:50.331278 run create_hlr_db(pid=19140): Launched 22:04:50.447334 bus /sierra_2: Setting Powered False 22:04:51.507256 run create_hlr_db(pid=19140): Terminated: ok {rc=0} 22:04:51.928484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19142): Launched 22:04:52.230888 run osmo-hlr_10.42.42.2(pid=19143): Launched 22:04:52.346893 run osmo-stp_10.42.42.5: Starting osmo-stp 22:04:52.866237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19145): Launched 22:04:53.166995 run osmo-stp_10.42.42.5(pid=19146): Launched 22:04:53.282106 run osmo-msc_10.42.42.6: Starting osmo-msc 22:04:53.827207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19148): Launched 22:04:54.127939 run osmo-msc_10.42.42.6(pid=19149): Launched 22:04:54.296477 run osmo-stp_10.42.42.5(pid=19146): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19146)] 22:04:54.425480 run osmo-stp_10.42.42.5(pid=19146): stdout: | (launched: 2022-12-08_22:04:53.112668) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:54.554052 run osmo-stp_10.42.42.5(pid=19146): stderr: | 20221208220453283 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220453283 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220453283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220453284 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220453284 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220453284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220453284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:54.681119 run osmo-stp_10.42.42.5(pid=19146): stdout: | (launched: 2022-12-08_22:04:53.112668) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:54.801179 run osmo-stp_10.42.42.5(pid=19146): stderr: | 20221208220453283 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220453283 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220453283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220453284 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220453284 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220453284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220453284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:54.945165 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19146): Process ended prematurely: osmo-stp_10.42.42.5(pid=19146) [trial-2350↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19146)] [trial-2350↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:04:54.954016 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:04:54.980704 run osmo-hlr_10.42.42.2(pid=19143): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19143)] 22:04:55.029948 run osmo-hlr_10.42.42.2(pid=19143): stdout: | (launched: 2022-12-08_22:04:52.176447) 22:04:55.080435 run osmo-hlr_10.42.42.2(pid=19143): stderr: | 20221208220452354 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220452354 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220452354 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220452354 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220452354 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220452354 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220452367 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220452375 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220452375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220452376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:04:55.150974 run osmo-msc_10.42.42.6(pid=19149): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19149)] 22:04:55.199784 run osmo-msc_10.42.42.6(pid=19149): stdout: | (launched: 2022-12-08_22:04:54.073097) 22:04:55.250243 run osmo-msc_10.42.42.6(pid=19149): stderr: | 20221208220454342 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208220454343 DLGLOBAL DEBUG validating counter group 0x7f1b29355c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208220454343 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208220454343 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208220454343 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208220454343 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208220454345 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208220454346 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208220454346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208220454346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:04:55.301064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19142): Terminating (SIGTERM) 22:04:55.341197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19145): Terminating (SIGTERM) 22:04:55.381908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19148): Terminating (SIGTERM) 22:04:55.422533 --- ParallelTerminationStrategy: PID 19142 died... 22:04:55.441683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19142): Terminated: ok {rc=0} 22:04:55.486784 --- ParallelTerminationStrategy: PID 19145 died... 22:04:55.505492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19145): Terminated: ok {rc=0} 22:04:55.550326 --- ParallelTerminationStrategy: PID 19148 died... 22:04:55.569136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19148): Terminated: ok {rc=0} 22:04:55.655021 bus /sierra_3: Setting Powered False 22:04:56.754623 bus /sierra_3: Setting Powered False 22:04:57.871192 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:04:59.020178 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:04:59.032348 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:04:59.104176 tst mo_mt_call_osmux.py: using LAC 17053 22:04:59.232425 tst mo_mt_call_osmux.py: using RAC 223 22:04:59.358654 tst mo_mt_call_osmux.py: using CellId 17053 22:04:59.487405 tst mo_mt_call_osmux.py: using BVCI 17054 22:04:59.605355 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:04:59.616850 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:04:59.628155 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:04:59.639394 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:04:59.650688 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:04:59.662047 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:04:59.780272 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:04:59.900893 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:05:00.399162 run create_hlr_db(pid=19151): Launched 22:05:00.530607 bus /sierra_2: Setting Powered False 22:05:01.593577 run create_hlr_db(pid=19151): Terminated: ok {rc=0} 22:05:02.070191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19156): Launched 22:05:02.402913 run osmo-hlr_10.42.42.2(pid=19157): Launched 22:05:02.525833 run osmo-stp_10.42.42.5: Starting osmo-stp 22:05:03.080005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19159): Launched 22:05:03.400842 run osmo-stp_10.42.42.5(pid=19160): Launched 22:05:03.523201 run osmo-msc_10.42.42.6: Starting osmo-msc 22:05:04.106394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19162): Launched 22:05:04.427971 run osmo-msc_10.42.42.6(pid=19163): Launched 22:05:04.608485 run osmo-stp_10.42.42.5(pid=19160): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19160)] 22:05:04.744709 run osmo-stp_10.42.42.5(pid=19160): stdout: | (launched: 2022-12-08_22:05:03.343286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:04.881761 run osmo-stp_10.42.42.5(pid=19160): stderr: | 20221208220503535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220503535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220503535 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220503535 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220503536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220503536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220503536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:05.018408 run osmo-stp_10.42.42.5(pid=19160): stdout: | (launched: 2022-12-08_22:05:03.343286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:05.146792 run osmo-stp_10.42.42.5(pid=19160): stderr: | 20221208220503535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220503535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220503535 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220503535 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220503536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220503536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220503536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:05.299932 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19160): Process ended prematurely: osmo-stp_10.42.42.5(pid=19160) [trial-2350↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19160)] [trial-2350↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:05:05.309438 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:05:05.337272 run osmo-hlr_10.42.42.2(pid=19157): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19157)] 22:05:05.388073 run osmo-hlr_10.42.42.2(pid=19157): stdout: | (launched: 2022-12-08_22:05:02.345098) 22:05:05.440602 run osmo-hlr_10.42.42.2(pid=19157): stderr: | 20221208220502542 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220502542 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220502542 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220502542 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220502542 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220502542 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220502554 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220502562 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220502563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220502563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:05:05.514115 run osmo-msc_10.42.42.6(pid=19163): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19163)] 22:05:05.565281 run osmo-msc_10.42.42.6(pid=19163): stdout: | (launched: 2022-12-08_22:05:04.370157) 22:05:05.617852 run osmo-msc_10.42.42.6(pid=19163): stderr: | 20221208220504692 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208220504692 DLGLOBAL DEBUG validating counter group 0x7f615b3e2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208220504692 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208220504692 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208220504693 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208220504693 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208220504694 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208220504695 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208220504695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208220504695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:05:05.670480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19156): Terminating (SIGTERM) 22:05:05.712852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19159): Terminating (SIGTERM) 22:05:05.755091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19162): Terminating (SIGTERM) 22:05:05.797387 --- ParallelTerminationStrategy: PID 19156 died... 22:05:05.817493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19156): Terminated: ok {rc=0} 22:05:05.863972 --- ParallelTerminationStrategy: PID 19159 died... 22:05:05.883611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19159): Terminated: ok {rc=0} 22:05:05.930079 --- ParallelTerminationStrategy: PID 19162 died... 22:05:05.949697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19162): Terminated: ok {rc=0} 22:05:06.037667 bus /sierra_3: Setting Powered False 22:05:07.136474 bus /sierra_3: Setting Powered False 22:05:08.254007 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:05:09.502108 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:05:09.508061 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:05:09.541737 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 22:05:09.567834 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 22:05:09.618573 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:05:09.651030 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 22:05:09.677918 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 22:05:10.231401 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 22:05:10.279785 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:10.290588 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:05:10.358340 tst mo_mt_call.py: using LAC 17054 22:05:10.478254 tst mo_mt_call.py: using RAC 224 22:05:10.597838 tst mo_mt_call.py: using CellId 17054 22:05:10.714733 tst mo_mt_call.py: using BVCI 17055 22:05:10.826897 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:10.837695 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:10.848231 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:10.859103 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:10.869948 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:10.880815 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:05:10.998899 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:05:11.114181 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:05:11.581570 run create_hlr_db(pid=19168): Launched 22:05:11.697451 bus /sierra_2: Setting Powered False 22:05:12.758532 run create_hlr_db(pid=19168): Terminated: ok {rc=0} 22:05:13.181096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19170): Launched 22:05:13.483534 run osmo-hlr_10.42.42.2(pid=19171): Launched 22:05:13.598857 run osmo-stp_10.42.42.5: Starting osmo-stp 22:05:14.116858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19173): Launched 22:05:14.419307 run osmo-stp_10.42.42.5(pid=19174): Launched 22:05:14.535109 run osmo-msc_10.42.42.6: Starting osmo-msc 22:05:15.083601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19176): Launched 22:05:15.385231 run osmo-msc_10.42.42.6(pid=19177): Launched 22:05:15.554578 run osmo-stp_10.42.42.5(pid=19174): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19174)] 22:05:15.684184 run osmo-stp_10.42.42.5(pid=19174): stdout: | (launched: 2022-12-08_22:05:14.364629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:15.813297 run osmo-stp_10.42.42.5(pid=19174): stderr: | 20221208220514534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220514534 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220514534 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220514535 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220514535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220514535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220514535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:15.967999 run osmo-stp_10.42.42.5(pid=19174): stdout: | (launched: 2022-12-08_22:05:14.364629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:16.091182 run osmo-stp_10.42.42.5(pid=19174): stderr: | 20221208220514534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220514534 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220514534 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220514535 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220514535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220514535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220514535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:16.238874 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19174): Process ended prematurely: osmo-stp_10.42.42.5(pid=19174) [trial-2350↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19174)] [trial-2350↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 22:05:16.248315 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:05:16.276708 run osmo-hlr_10.42.42.2(pid=19171): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19171)] 22:05:16.327227 run osmo-hlr_10.42.42.2(pid=19171): stdout: | (launched: 2022-12-08_22:05:13.428057) 22:05:16.379191 run osmo-hlr_10.42.42.2(pid=19171): stderr: | 20221208220513603 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220513603 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220513603 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220513603 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220513603 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220513603 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220513615 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220513623 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220513623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220513623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:05:16.451780 run osmo-msc_10.42.42.6(pid=19177): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19177)] 22:05:16.517807 run osmo-msc_10.42.42.6(pid=19177): stdout: | (launched: 2022-12-08_22:05:15.330215) 22:05:16.588319 run osmo-msc_10.42.42.6(pid=19177): stderr: | 20221208220515602 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208220515602 DLGLOBAL DEBUG validating counter group 0x7fd51ba6bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208220515602 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208220515602 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208220515602 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208220515603 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208220515607 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208220515608 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208220515608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208220515608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:05:16.646538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19170): Terminating (SIGTERM) 22:05:16.689428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19173): Terminating (SIGTERM) 22:05:16.732089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19176): Terminating (SIGTERM) 22:05:16.775051 --- ParallelTerminationStrategy: PID 19170 died... 22:05:16.795104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19170): Terminated: ok {rc=0} 22:05:16.842770 --- ParallelTerminationStrategy: PID 19173 died... 22:05:16.862522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19173): Terminated: ok {rc=0} 22:05:16.909744 --- ParallelTerminationStrategy: PID 19176 died... 22:05:16.929495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19176): Terminated: ok {rc=0} 22:05:17.018026 bus /sierra_3: Setting Powered False 22:05:18.115685 bus /sierra_3: Setting Powered False 22:05:19.234137 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 22:05:20.384535 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:20.396478 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:05:20.472487 tst mo_mt_call_osmux.py: using LAC 17055 22:05:20.600113 tst mo_mt_call_osmux.py: using RAC 225 22:05:20.718541 tst mo_mt_call_osmux.py: using CellId 17055 22:05:20.836210 tst mo_mt_call_osmux.py: using BVCI 17056 22:05:20.946779 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:20.957786 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:20.968596 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:20.979664 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:20.990545 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:21.001481 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:05:21.117723 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:05:21.234764 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:05:21.705206 run create_hlr_db(pid=19179): Launched 22:05:21.820730 bus /sierra_2: Setting Powered False 22:05:22.881541 run create_hlr_db(pid=19179): Terminated: ok {rc=0} 22:05:23.322224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19181): Launched 22:05:23.644769 run osmo-hlr_10.42.42.2(pid=19182): Launched 22:05:23.767683 run osmo-stp_10.42.42.5: Starting osmo-stp 22:05:24.327499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19184): Launched 22:05:24.650686 run osmo-stp_10.42.42.5(pid=19185): Launched 22:05:24.773308 run osmo-msc_10.42.42.6: Starting osmo-msc 22:05:25.356681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19187): Launched 22:05:25.678714 run osmo-msc_10.42.42.6(pid=19188): Launched 22:05:25.857703 run osmo-stp_10.42.42.5(pid=19185): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19185)] 22:05:25.993455 run osmo-stp_10.42.42.5(pid=19185): stdout: | (launched: 2022-12-08_22:05:24.592496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:26.129890 run osmo-stp_10.42.42.5(pid=19185): stderr: | 20221208220524783 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220524783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220524783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220524783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220524786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220524786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220524786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:26.265532 run osmo-stp_10.42.42.5(pid=19185): stdout: | (launched: 2022-12-08_22:05:24.592496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:26.394038 run osmo-stp_10.42.42.5(pid=19185): stderr: | 20221208220524783 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220524783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220524783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220524783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220524786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220524786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220524786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:26.548688 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19185): Process ended prematurely: osmo-stp_10.42.42.5(pid=19185) [trial-2350↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19185)] [trial-2350↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 22:05:26.558397 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:05:26.586743 run osmo-hlr_10.42.42.2(pid=19182): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19182)] 22:05:26.638024 run osmo-hlr_10.42.42.2(pid=19182): stdout: | (launched: 2022-12-08_22:05:23.586359) 22:05:26.690648 run osmo-hlr_10.42.42.2(pid=19182): stderr: | 20221208220523786 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220523787 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220523787 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220523787 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220523787 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220523787 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220523799 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220523809 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220523809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220523809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:05:26.764116 run osmo-msc_10.42.42.6(pid=19188): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19188)] 22:05:26.815266 run osmo-msc_10.42.42.6(pid=19188): stdout: | (launched: 2022-12-08_22:05:25.620588) 22:05:26.867870 run osmo-msc_10.42.42.6(pid=19188): stderr: | 20221208220525942 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208220525942 DLGLOBAL DEBUG validating counter group 0x7faeba711c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208220525942 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208220525942 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208220525942 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208220525942 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208220525944 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208220525944 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208220525944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208220525944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:05:26.921070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19181): Terminating (SIGTERM) 22:05:26.963391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19184): Terminating (SIGTERM) 22:05:27.006061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19187): Terminating (SIGTERM) 22:05:27.049045 --- ParallelTerminationStrategy: PID 19181 died... 22:05:27.069298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19181): Terminated: ok {rc=0} 22:05:27.116797 --- ParallelTerminationStrategy: PID 19184 died... 22:05:27.136525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19184): Terminated: ok {rc=0} 22:05:27.183705 --- ParallelTerminationStrategy: PID 19187 died... 22:05:27.203590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19187): Terminated: ok {rc=0} 22:05:27.292941 bus /sierra_3: Setting Powered False 22:05:28.392429 bus /sierra_3: Setting Powered False 22:05:29.510307 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 22:05:30.765691 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:05:30.770820 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 22:05:30.804359 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 22:05:30.845150 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 22:05:30.913768 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 22:05:30.957965 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 22:05:30.985553 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 22:05:31.544416 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 22:05:31.611487 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:31.626968 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 22:05:31.683682 tst mo_mt_call.py: using LAC 17056 22:05:31.808208 tst mo_mt_call.py: using RAC 226 22:05:31.934814 tst mo_mt_call.py: using CellId 17056 22:05:32.056013 tst mo_mt_call.py: using BVCI 17057 22:05:32.170930 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:32.182370 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:32.193723 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:32.206239 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:32.218648 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:32.232726 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 22:05:32.355175 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 22:05:32.470140 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:05:32.941077 run create_hlr_db(pid=19194): Launched 22:05:33.057340 bus /sierra_2: Setting Powered False 22:05:34.118455 run create_hlr_db(pid=19194): Terminated: ok {rc=0} 22:05:34.540778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19196): Launched 22:05:34.842913 run osmo-hlr_10.42.42.2(pid=19197): Launched 22:05:34.958610 run osmo-stp_10.42.42.5: Starting osmo-stp 22:05:35.489698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19199): Launched 22:05:35.789540 run osmo-stp_10.42.42.5(pid=19200): Launched 22:05:35.905176 run osmo-msc_10.42.42.6: Starting osmo-msc 22:05:36.454358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19202): Launched 22:05:36.756242 run osmo-msc_10.42.42.6(pid=19203): Launched 22:05:36.925276 run osmo-stp_10.42.42.5(pid=19200): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19200)] 22:05:37.054103 run osmo-stp_10.42.42.5(pid=19200): stdout: | (launched: 2022-12-08_22:05:35.735218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:37.183035 run osmo-stp_10.42.42.5(pid=19200): stderr: | 20221208220535905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220535905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220535905 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220535906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220535906 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220535906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220535906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:37.309342 run osmo-stp_10.42.42.5(pid=19200): stdout: | (launched: 2022-12-08_22:05:35.735218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:37.429595 run osmo-stp_10.42.42.5(pid=19200): stderr: | 20221208220535905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220535905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220535905 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220535906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220535906 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220535906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220535906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:37.574302 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19200): Process ended prematurely: osmo-stp_10.42.42.5(pid=19200) [trial-2350↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19200)] [trial-2350↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 22:05:37.583200 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:05:37.610331 run osmo-hlr_10.42.42.2(pid=19197): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19197)] 22:05:37.659312 run osmo-hlr_10.42.42.2(pid=19197): stdout: | (launched: 2022-12-08_22:05:34.787962) 22:05:37.709854 run osmo-hlr_10.42.42.2(pid=19197): stderr: | 20221208220534964 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220534964 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220534964 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220534964 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220534964 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220534964 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220534976 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220534985 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220534985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220534985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:05:37.780007 run osmo-msc_10.42.42.6(pid=19203): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19203)] 22:05:37.828480 run osmo-msc_10.42.42.6(pid=19203): stdout: | (launched: 2022-12-08_22:05:36.701731) 22:05:37.878645 run osmo-msc_10.42.42.6(pid=19203): stderr: | 20221208220536974 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208220536974 DLGLOBAL DEBUG validating counter group 0x7f714eb01c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208220536974 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208220536975 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208220536975 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208220536975 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208220536977 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208220536978 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208220536978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208220536978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:05:37.929314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19196): Terminating (SIGTERM) 22:05:37.969408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19199): Terminating (SIGTERM) 22:05:38.010034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19202): Terminating (SIGTERM) 22:05:38.050759 --- ParallelTerminationStrategy: PID 19196 died... 22:05:38.070188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19196): Terminated: ok {rc=0} 22:05:38.115683 --- ParallelTerminationStrategy: PID 19199 died... 22:05:38.134662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19199): Terminated: ok {rc=0} 22:05:38.180751 --- ParallelTerminationStrategy: PID 19202 died... 22:05:38.199758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19202): Terminated: ok {rc=0} 22:05:38.284933 bus /sierra_3: Setting Powered False 22:05:39.385449 bus /sierra_3: Setting Powered False 22:05:40.503197 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 22:05:41.653581 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:41.665420 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 22:05:41.721038 tst mo_mt_call_osmux.py: using LAC 17057 22:05:41.846188 tst mo_mt_call_osmux.py: using RAC 227 22:05:41.971804 tst mo_mt_call_osmux.py: using CellId 17057 22:05:42.096867 tst mo_mt_call_osmux.py: using BVCI 17058 22:05:42.213948 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:42.225294 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:42.236300 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:42.247427 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:42.258503 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:42.269625 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 22:05:42.387547 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 22:05:42.505779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:05:43.007802 run create_hlr_db(pid=19205): Launched 22:05:43.138412 bus /sierra_2: Setting Powered False 22:05:44.202676 run create_hlr_db(pid=19205): Terminated: ok {rc=0} 22:05:44.635453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19207): Launched 22:05:44.938370 run osmo-hlr_10.42.42.2(pid=19208): Launched 22:05:45.053249 run osmo-stp_10.42.42.5: Starting osmo-stp 22:05:45.588109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19210): Launched 22:05:45.911604 run osmo-stp_10.42.42.5(pid=19211): Launched 22:05:46.088557 run osmo-msc_10.42.42.6: Starting osmo-msc 22:05:46.806878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19213): Launched 22:05:47.146091 run osmo-msc_10.42.42.6(pid=19214): Launched 22:05:47.388329 run osmo-stp_10.42.42.5(pid=19211): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19211)] 22:05:47.517583 run osmo-stp_10.42.42.5(pid=19211): stdout: | (launched: 2022-12-08_22:05:45.841894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:47.647565 run osmo-stp_10.42.42.5(pid=19211): stderr: | 20221208220546203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220546203 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220546203 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220546204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220546204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220546204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220546204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:47.774887 run osmo-stp_10.42.42.5(pid=19211): stdout: | (launched: 2022-12-08_22:05:45.841894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:47.895682 run osmo-stp_10.42.42.5(pid=19211): stderr: | 20221208220546203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220546203 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220546203 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220546204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220546204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220546204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220546204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:48.039975 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19211): Process ended prematurely: osmo-stp_10.42.42.5(pid=19211) [trial-2350↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19211)] [trial-2350↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 22:05:48.048930 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 22:05:48.076862 run osmo-hlr_10.42.42.2(pid=19208): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19208)] 22:05:48.126464 run osmo-hlr_10.42.42.2(pid=19208): stdout: | (launched: 2022-12-08_22:05:44.883645) 22:05:48.177505 run osmo-hlr_10.42.42.2(pid=19208): stderr: | 20221208220545060 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220545060 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220545060 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220545060 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220545060 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220545060 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220545071 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220545080 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220545080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220545080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:05:48.248472 run osmo-msc_10.42.42.6(pid=19214): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19214)] 22:05:48.297880 run osmo-msc_10.42.42.6(pid=19214): stdout: | (launched: 2022-12-08_22:05:47.083825) 22:05:48.348834 run osmo-msc_10.42.42.6(pid=19214): stderr: | 20221208220547456 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208220547456 DLGLOBAL DEBUG validating counter group 0x7feabee67c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208220547456 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208220547456 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208220547456 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208220547457 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208220547460 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208220547461 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208220547461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208220547461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:05:48.400237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19207): Terminating (SIGTERM) 22:05:48.441256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19210): Terminating (SIGTERM) 22:05:48.482707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19213): Terminating (SIGTERM) 22:05:48.524356 --- ParallelTerminationStrategy: PID 19207 died... 22:05:48.544027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19207): Terminated: ok {rc=0} 22:05:48.590235 --- ParallelTerminationStrategy: PID 19210 died... 22:05:48.609391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19210): Terminated: ok {rc=0} 22:05:48.655700 --- ParallelTerminationStrategy: PID 19213 died... 22:05:48.674796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19213): Terminated: ok {rc=0} 22:05:48.763561 bus /sierra_3: Setting Powered False 22:05:49.863733 bus /sierra_3: Setting Powered False 22:05:50.980547 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 22:05:52.233044 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:05:52.239676 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 22:05:52.273221 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 22:05:52.300795 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 22:05:52.353196 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 22:05:52.386668 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 22:05:52.413678 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 22:05:52.967648 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 22:05:53.019090 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:05:53.030732 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:05:53.083385 tst mo_mt_call.py: using LAC 17058 22:05:53.209880 tst mo_mt_call.py: using RAC 228 22:05:53.341302 tst mo_mt_call.py: using CellId 17058 22:05:53.462753 tst mo_mt_call.py: using BVCI 17059 22:05:53.575372 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:05:53.586808 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:05:53.598118 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:05:53.610158 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:05:53.621819 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:05:53.633299 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:05:53.749358 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:05:53.867392 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:05:54.370082 run create_hlr_db(pid=19219): Launched 22:05:54.501768 bus /sierra_2: Setting Powered False 22:05:55.566144 run create_hlr_db(pid=19219): Terminated: ok {rc=0} 22:05:56.015023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19221): Launched 22:05:56.335885 run osmo-hlr_10.42.42.2(pid=19222): Launched 22:05:56.458544 run osmo-stp_10.42.42.5: Starting osmo-stp 22:05:57.013218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19224): Launched 22:05:57.334874 run osmo-stp_10.42.42.5(pid=19225): Launched 22:05:57.457850 run osmo-msc_10.42.42.6: Starting osmo-msc 22:05:58.040639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19227): Launched 22:05:58.361768 run osmo-msc_10.42.42.6(pid=19228): Launched 22:05:58.540890 run osmo-stp_10.42.42.5(pid=19225): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19225)] 22:05:58.678787 run osmo-stp_10.42.42.5(pid=19225): stdout: | (launched: 2022-12-08_22:05:57.276862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:58.815993 run osmo-stp_10.42.42.5(pid=19225): stderr: | 20221208220557469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220557470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220557470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220557470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220557471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220557471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220557471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:58.952016 run osmo-stp_10.42.42.5(pid=19225): stdout: | (launched: 2022-12-08_22:05:57.276862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:59.080865 run osmo-stp_10.42.42.5(pid=19225): stderr: | 20221208220557469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220557470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220557470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220557470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220557471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220557471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220557471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:59.235016 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19225): Process ended prematurely: osmo-stp_10.42.42.5(pid=19225) [trial-2350↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19225)] [trial-2350↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 22:05:59.244666 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:05:59.272824 run osmo-hlr_10.42.42.2(pid=19222): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19222)] 22:05:59.323521 run osmo-hlr_10.42.42.2(pid=19222): stdout: | (launched: 2022-12-08_22:05:56.278046) 22:05:59.376109 run osmo-hlr_10.42.42.2(pid=19222): stderr: | 20221208220556474 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220556475 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220556475 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220556475 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220556475 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220556475 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220556487 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220556495 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220556495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220556495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:05:59.449341 run osmo-msc_10.42.42.6(pid=19228): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19228)] 22:05:59.500069 run osmo-msc_10.42.42.6(pid=19228): stdout: | (launched: 2022-12-08_22:05:58.303825) 22:05:59.552132 run osmo-msc_10.42.42.6(pid=19228): stderr: | 20221208220558624 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208220558624 DLGLOBAL DEBUG validating counter group 0x7f4f4be27c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208220558624 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208220558624 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208220558624 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208220558624 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208220558626 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208220558626 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208220558626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208220558627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:05:59.605326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19221): Terminating (SIGTERM) 22:05:59.647507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19224): Terminating (SIGTERM) 22:05:59.689711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19227): Terminating (SIGTERM) 22:05:59.732202 --- ParallelTerminationStrategy: PID 19221 died... 22:05:59.752322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19221): Terminated: ok {rc=0} 22:05:59.799006 --- ParallelTerminationStrategy: PID 19224 died... 22:05:59.818857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19224): Terminated: ok {rc=0} 22:05:59.865675 --- ParallelTerminationStrategy: PID 19227 died... 22:05:59.885525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19227): Terminated: ok {rc=0} 22:05:59.973562 bus /sierra_3: Setting Powered False 22:06:01.072858 bus /sierra_3: Setting Powered False 22:06:02.193067 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 22:06:03.340216 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:06:03.352308 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:06:03.405112 tst mo_mt_call_osmux.py: using LAC 17059 22:06:03.525696 tst mo_mt_call_osmux.py: using RAC 229 22:06:03.654897 tst mo_mt_call_osmux.py: using CellId 17059 22:06:03.789275 tst mo_mt_call_osmux.py: using BVCI 17060 22:06:03.907836 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:06:03.919839 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:06:03.931667 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:06:03.943610 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:06:03.955512 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:06:03.967214 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:06:04.084269 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:06:04.202972 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:06:04.673743 run create_hlr_db(pid=19230): Launched 22:06:04.790974 bus /sierra_2: Setting Powered False 22:06:05.851426 run create_hlr_db(pid=19230): Terminated: ok {rc=0} 22:06:06.293721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19232): Launched 22:06:06.617617 run osmo-hlr_10.42.42.2(pid=19233): Launched 22:06:06.740840 run osmo-stp_10.42.42.5: Starting osmo-stp 22:06:07.297972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19235): Launched 22:06:07.619851 run osmo-stp_10.42.42.5(pid=19236): Launched 22:06:07.742903 run osmo-msc_10.42.42.6: Starting osmo-msc 22:06:08.325238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19238): Launched 22:06:08.646898 run osmo-msc_10.42.42.6(pid=19239): Launched 22:06:08.826401 run osmo-stp_10.42.42.5(pid=19236): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19236)] 22:06:08.962772 run osmo-stp_10.42.42.5(pid=19236): stdout: | (launched: 2022-12-08_22:06:07.561414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:09.099874 run osmo-stp_10.42.42.5(pid=19236): stderr: | 20221208220607755 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220607755 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220607755 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220607756 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220607756 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220607756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220607756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:09.235843 run osmo-stp_10.42.42.5(pid=19236): stdout: | (launched: 2022-12-08_22:06:07.561414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:09.364331 run osmo-stp_10.42.42.5(pid=19236): stderr: | 20221208220607755 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220607755 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220607755 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220607756 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220607756 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220607756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220607756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:09.517923 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19236): Process ended prematurely: osmo-stp_10.42.42.5(pid=19236) [trial-2350↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19236)] [trial-2350↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 22:06:09.527652 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:06:09.555963 run osmo-hlr_10.42.42.2(pid=19233): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19233)] 22:06:09.607326 run osmo-hlr_10.42.42.2(pid=19233): stdout: | (launched: 2022-12-08_22:06:06.559097) 22:06:09.660254 run osmo-hlr_10.42.42.2(pid=19233): stderr: | 20221208220606757 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220606757 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220606757 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220606757 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220606757 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220606758 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220606770 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220606778 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220606778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220606778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:06:09.734834 run osmo-msc_10.42.42.6(pid=19239): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19239)] 22:06:09.785451 run osmo-msc_10.42.42.6(pid=19239): stdout: | (launched: 2022-12-08_22:06:08.588701) 22:06:09.837710 run osmo-msc_10.42.42.6(pid=19239): stderr: | 20221208220608913 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208220608913 DLGLOBAL DEBUG validating counter group 0x7f2d51920c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208220608913 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208220608913 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208220608913 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208220608913 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208220608915 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208220608915 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208220608915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208220608915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:06:09.890311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19232): Terminating (SIGTERM) 22:06:09.932472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19235): Terminating (SIGTERM) 22:06:09.974667 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19238): Terminating (SIGTERM) 22:06:10.017196 --- ParallelTerminationStrategy: PID 19232 died... 22:06:10.037319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19232): Terminated: ok {rc=0} 22:06:10.084417 --- ParallelTerminationStrategy: PID 19235 died... 22:06:10.104270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19235): Terminated: ok {rc=0} 22:06:10.151050 --- ParallelTerminationStrategy: PID 19238 died... 22:06:10.170815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19238): Terminated: ok {rc=0} 22:06:10.259283 bus /sierra_3: Setting Powered False 22:06:11.360593 bus /sierra_3: Setting Powered False 22:06:12.477667 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 emergency:trx-b200 --------------------------------------------------------------------- 22:06:13.731919 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:06:13.736604 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 22:06:13.770758 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 22:06:13.798278 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 22:06:13.884528 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 22:06:13.918070 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 22:06:13.945182 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 22:06:14.529132 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2350 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 22:06:14.534432 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:14.545548 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 22:06:14.596114 tst emergency_mo_mt_call.py: using LAC 17060 22:06:14.720913 tst emergency_mo_mt_call.py: using RAC 230 22:06:14.844665 tst emergency_mo_mt_call.py: using CellId 17060 22:06:14.969998 tst emergency_mo_mt_call.py: using BVCI 17061 22:06:15.080202 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:15.090785 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:15.101208 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:15.111749 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:15.122641 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:15.133238 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 22:06:15.250496 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 22:06:15.367881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:06:15.876934 run create_hlr_db(pid=19244): Launched 22:06:16.019912 bus /sierra_2: Setting Powered False 22:06:17.094548 run create_hlr_db(pid=19244): Terminated: ok {rc=0} 22:06:17.536836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19246): Launched 22:06:17.839588 run osmo-hlr_10.42.42.2(pid=19247): Launched 22:06:17.961475 run osmo-stp_10.42.42.5: Starting osmo-stp 22:06:18.514665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19249): Launched 22:06:18.831533 run osmo-stp_10.42.42.5(pid=19250): Launched 22:06:18.962620 tst emergency_mo_mt_call.py: using MSISDN 6876 22:06:19.126288 run osmo-msc_10.42.42.6: Starting osmo-msc 22:06:19.695738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19252): Launched 22:06:20.011635 run osmo-msc_10.42.42.6(pid=19253): Launched 22:06:20.186908 run osmo-stp_10.42.42.5(pid=19250): ERR: Terminated: ERROR {rc=1} [trial-2350↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19250)] 22:06:20.320193 run osmo-stp_10.42.42.5(pid=19250): stdout: | (launched: 2022-12-08_22:06:18.774819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:20.454862 run osmo-stp_10.42.42.5(pid=19250): stderr: | 20221208220618965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220618965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220618966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220618966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220618967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220618967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220618967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:20.589270 run osmo-stp_10.42.42.5(pid=19250): stdout: | (launched: 2022-12-08_22:06:18.774819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:20.715938 run osmo-stp_10.42.42.5(pid=19250): stderr: | 20221208220618965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220618965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220618966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220618966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220618967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220618967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220618967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:20.866907 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=19250): Process ended prematurely: osmo-stp_10.42.42.5(pid=19250) [trial-2350↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19250)] [trial-2350↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 22:06:20.875976 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 22:06:20.903839 run osmo-hlr_10.42.42.2(pid=19247): ERR: Terminated: ERROR {rc=237} [trial-2350↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19247)] 22:06:20.955384 run osmo-hlr_10.42.42.2(pid=19247): stdout: | (launched: 2022-12-08_22:06:17.782776) 22:06:21.008420 run osmo-hlr_10.42.42.2(pid=19247): stderr: | 20221208220617981 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220617981 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220617981 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220617981 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220617981 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220617981 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220617993 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220618001 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220618001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220618001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:06:21.081815 run osmo-msc_10.42.42.6(pid=19253): ERR: Terminated: ERROR {rc=2} [trial-2350↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19253)] 22:06:21.132570 run osmo-msc_10.42.42.6(pid=19253): stdout: | (launched: 2022-12-08_22:06:19.954530) 22:06:21.184691 run osmo-msc_10.42.42.6(pid=19253): stderr: | 20221208220620277 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208220620277 DLGLOBAL DEBUG validating counter group 0x7f1357f1bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208220620277 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208220620277 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208220620278 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208220620278 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208220620280 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208220620280 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208220620280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208220620280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:06:21.237468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19246): Terminating (SIGTERM) 22:06:21.279613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19249): Terminating (SIGTERM) 22:06:21.322133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19252): Terminating (SIGTERM) 22:06:21.364636 --- ParallelTerminationStrategy: PID 19246 died... 22:06:21.384899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19246): Terminated: ok {rc=0} 22:06:21.431850 --- ParallelTerminationStrategy: PID 19249 died... 22:06:21.451798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19249): Terminated: ok {rc=0} 22:06:21.498818 --- ParallelTerminationStrategy: PID 19252 died... 22:06:21.518583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19252): Terminated: ok {rc=0} 22:06:21.608271 bus /sierra_3: Setting Powered False 22:06:22.705594 bus /sierra_3: Setting Powered False 22:06:23.822611 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 22:06:24.909911 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:24.921134 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 22:06:24.971224 tst emergency_preemptive_call.py: using LAC 17061 22:06:25.089258 tst emergency_preemptive_call.py: using RAC 231 22:06:25.211369 tst emergency_preemptive_call.py: using CellId 17061 22:06:25.329498 tst emergency_preemptive_call.py: using BVCI 17062 22:06:25.445270 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:25.456466 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:25.467486 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:25.478710 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:25.490017 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:25.501581 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 22:06:25.617325 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 22:06:25.731463 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 22:06:25.849779 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 22:06:25.964538 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:06:26.424796 run create_hlr_db(pid=19255): Launched 22:06:26.538169 bus /sierra_2: Setting Powered False 22:06:27.598040 run create_hlr_db(pid=19255): Terminated: ok {rc=0} 22:06:28.033048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19257): Launched 22:06:28.349323 run osmo-hlr_10.42.42.2(pid=19258): Launched 22:06:28.470538 run osmo-stp_10.42.42.5: Starting osmo-stp 22:06:29.021218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19260): Launched 22:06:29.337660 run osmo-stp_10.42.42.5(pid=19261): Launched 22:06:29.469229 tst emergency_preemptive_call.py: using MSISDN 6877 22:06:29.633836 run osmo-msc_10.42.42.6: Starting osmo-msc 22:06:30.201679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19263): Launched 22:06:30.516578 run osmo-msc_10.42.42.6(pid=19264): Launched 22:06:30.694309 run osmo-stp_10.42.42.5(pid=19261): ERR: Terminated: ERROR {rc=1} [trial-2350↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19261)] 22:06:30.851037 run osmo-stp_10.42.42.5(pid=19261): stdout: | (launched: 2022-12-08_22:06:29.280486) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:31.151844 run osmo-stp_10.42.42.5(pid=19261): stderr: | 20221208220629469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220629469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220629469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220629470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220629470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220629470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220629470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:31.288416 run osmo-stp_10.42.42.5(pid=19261): stdout: | (launched: 2022-12-08_22:06:29.280486) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:31.417966 run osmo-stp_10.42.42.5(pid=19261): stderr: | 20221208220629469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220629469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220629469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220629470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220629470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220629470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220629470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:31.573463 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=19261): Process ended prematurely: osmo-stp_10.42.42.5(pid=19261) [trial-2350↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19261)] [trial-2350↪emergency:trx-b200↪emergency_preemptive_call.py:32] 22:06:31.583702 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 22:06:31.613305 run osmo-hlr_10.42.42.2(pid=19258): ERR: Terminated: ERROR {rc=237} [trial-2350↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19258)] 22:06:31.665949 run osmo-hlr_10.42.42.2(pid=19258): stdout: | (launched: 2022-12-08_22:06:28.292244) 22:06:31.720051 run osmo-hlr_10.42.42.2(pid=19258): stderr: | 20221208220628487 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220628487 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220628487 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220628487 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220628487 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220628488 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220628501 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220628510 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220628511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220628511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:06:31.795670 run osmo-msc_10.42.42.6(pid=19264): ERR: Terminated: ERROR {rc=2} [trial-2350↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19264)] 22:06:31.848230 run osmo-msc_10.42.42.6(pid=19264): stdout: | (launched: 2022-12-08_22:06:30.459601) 22:06:31.902358 run osmo-msc_10.42.42.6(pid=19264): stderr: | 20221208220630781 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208220630781 DLGLOBAL DEBUG validating counter group 0x7f270258bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208220630781 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208220630781 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208220630781 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208220630781 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208220630783 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208220630784 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208220630784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208220630784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:06:31.956890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19257): Terminating (SIGTERM) 22:06:32.001353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19260): Terminating (SIGTERM) 22:06:32.046753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19263): Terminating (SIGTERM) 22:06:32.091066 --- ParallelTerminationStrategy: PID 19257 died... 22:06:32.111582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19257): Terminated: ok {rc=0} 22:06:32.159904 --- ParallelTerminationStrategy: PID 19260 died... 22:06:32.180304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19260): Terminated: ok {rc=0} 22:06:32.228222 --- ParallelTerminationStrategy: PID 19263 died... 22:06:32.248308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19263): Terminated: ok {rc=0} 22:06:32.337500 bus /sierra_9: Setting Powered False 22:06:33.437265 bus /sierra_9: Setting Powered False 22:06:34.555232 bus /sierra_8: Setting Powered False 22:06:35.655413 bus /sierra_8: Setting Powered False 22:06:36.772718 bus /sierra_3: Setting Powered False 22:06:37.872745 bus /sierra_3: Setting Powered False 22:06:38.990620 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:trx-b200 --------------------------------------------------------------------- 22:06:40.266327 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:06:40.272025 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 22:06:40.305620 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 22:06:40.344692 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 22:06:40.433572 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 22:06:40.467732 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 22:06:40.506726 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 22:06:41.096167 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 22:06:41.149261 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:41.160217 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 22:06:41.210467 tst cs_paging_gprs_active.py: using LAC 17062 22:06:41.339759 tst cs_paging_gprs_active.py: using RAC 232 22:06:41.469377 tst cs_paging_gprs_active.py: using CellId 17062 22:06:41.603652 tst cs_paging_gprs_active.py: using BVCI 17063 22:06:41.723635 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:41.734652 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:41.745506 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:41.756190 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:41.766815 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:41.777447 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:41.788191 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:41.798863 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:41.809710 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:06:41.925975 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:06:42.040537 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:06:42.244478 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:06:42.548899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19269): Launched 22:06:42.813229 run iperf3-srv_10.42.42.10(pid=19270): Launched 22:06:42.927544 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:06:43.131046 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:06:43.436033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19271): Launched 22:06:43.701043 run iperf3-srv_10.42.42.10(pid=19272): Launched 22:06:43.815762 tst cs_paging_gprs_active.py:38: start network... 22:06:44.019314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:06:44.489506 run create_hlr_db(pid=19273): Launched 22:06:44.606693 bus /sierra_2: Setting Powered False 22:06:45.667316 run create_hlr_db(pid=19273): Terminated: ok {rc=0} 22:06:46.136138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19275): Launched 22:06:46.483046 run osmo-hlr_10.42.42.2(pid=19276): Launched 22:06:46.809682 run osmo-stp_10.42.42.5: Starting osmo-stp 22:06:47.560830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19278): Launched 22:06:47.884455 run osmo-stp_10.42.42.5(pid=19279): Launched 22:06:48.007187 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:06:48.566381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19281): Launched 22:06:48.690887 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:06:48.964654 run patchelf(pid=19282): Launched 22:06:49.144481 run osmo-stp_10.42.42.5(pid=19279): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19279)] 22:06:49.283080 run osmo-stp_10.42.42.5(pid=19279): stdout: | (launched: 2022-12-08_22:06:47.826424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:49.422734 run osmo-stp_10.42.42.5(pid=19279): stderr: | 20221208220648019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220648019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220648019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220648020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220648020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220648020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220648020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:49.561985 run osmo-stp_10.42.42.5(pid=19279): stdout: | (launched: 2022-12-08_22:06:47.826424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:49.696838 run osmo-stp_10.42.42.5(pid=19279): stderr: | 20221208220648019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220648019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220648019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220648020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220648020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220648020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220648020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:49.855564 run patchelf(pid=19282): Terminating (SIGINT) 22:06:50.037219 run patchelf(pid=19282): Terminated: ok {rc=0} 22:06:50.168298 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19279): Process ended prematurely: osmo-stp_10.42.42.5(pid=19279) [trial-2350↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19279)] [trial-2350↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 22:06:50.178857 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 22:06:50.207814 run osmo-hlr_10.42.42.2(pid=19276): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19276)] 22:06:50.258762 run osmo-hlr_10.42.42.2(pid=19276): stdout: | (launched: 2022-12-08_22:06:46.413879) 22:06:50.311714 run osmo-hlr_10.42.42.2(pid=19276): stderr: | 20221208220646798 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220646798 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220646798 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220646798 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220646798 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220646798 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220646817 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220646833 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220646834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220646834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:06:50.364556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19269): Terminating (SIGTERM) 22:06:50.407264 run iperf3-srv_10.42.42.10(pid=19270): Terminating (SIGTERM) 22:06:50.449834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19271): Terminating (SIGTERM) 22:06:50.492553 run iperf3-srv_10.42.42.10(pid=19272): Terminating (SIGTERM) 22:06:50.535159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19275): Terminating (SIGTERM) 22:06:50.577800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19278): Terminating (SIGTERM) 22:06:50.620792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19281): Terminating (SIGTERM) 22:06:50.663695 --- ParallelTerminationStrategy: PID 19269 died... 22:06:50.684212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19269): Terminated: ok {rc=0} 22:06:50.731703 --- ParallelTerminationStrategy: PID 19270 died... 22:06:50.751581 run iperf3-srv_10.42.42.10(pid=19270): Terminated {rc=256} 22:06:50.798428 --- ParallelTerminationStrategy: PID 19271 died... 22:06:50.818255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19271): Terminated: ok {rc=0} 22:06:50.865091 --- ParallelTerminationStrategy: PID 19272 died... 22:06:50.885058 run iperf3-srv_10.42.42.10(pid=19272): Terminated {rc=256} 22:06:50.931751 --- ParallelTerminationStrategy: PID 19275 died... 22:06:50.951628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19275): Terminated: ok {rc=0} 22:06:50.998306 --- ParallelTerminationStrategy: PID 19278 died... 22:06:51.018192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19278): Terminated: ok {rc=0} 22:06:51.065242 --- ParallelTerminationStrategy: PID 19281 died... 22:06:51.085281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19281): Terminated: ok {rc=0} 22:06:51.173995 bus /gobi_0: Setting Powered False 22:06:52.276010 bus /gobi_0: Setting Powered False 22:06:53.394370 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-b200 iperf3.py ---------------------------------------------- 22:06:54.539142 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:54.550261 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 22:06:54.601191 tst iperf3.py: using LAC 17063 22:06:54.722388 tst iperf3.py: using RAC 233 22:06:54.844036 tst iperf3.py: using CellId 17063 22:06:54.964889 tst iperf3.py: using BVCI 17064 22:06:55.077444 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:55.088041 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:55.098600 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:55.109332 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:55.120162 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:55.130877 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:55.141738 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:55.152303 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:55.163119 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:06:55.281948 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:06:55.485369 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:06:55.788756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19283): Launched 22:06:56.051989 run iperf3-srv_10.42.42.10(pid=19284): Launched 22:06:56.166020 tst iperf3.py:8: start network... 22:06:56.368551 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:06:56.835993 run create_hlr_db(pid=19285): Launched 22:06:56.950581 bus /gobi_6: Setting Powered False 22:06:58.010417 run create_hlr_db(pid=19285): Terminated: ok {rc=0} 22:06:58.450823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19287): Launched 22:06:58.772624 run osmo-hlr_10.42.42.2(pid=19288): Launched 22:06:58.895066 run osmo-stp_10.42.42.5: Starting osmo-stp 22:06:59.457667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19290): Launched 22:06:59.780251 run osmo-stp_10.42.42.5(pid=19291): Launched 22:06:59.903511 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:07:00.459811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19293): Launched 22:07:00.583197 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:07:00.855273 run patchelf(pid=19294): Launched 22:07:01.068420 run osmo-stp_10.42.42.5(pid=19291): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19291)] 22:07:01.208306 run osmo-stp_10.42.42.5(pid=19291): stdout: | (launched: 2022-12-08_22:06:59.722255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:01.350110 run osmo-stp_10.42.42.5(pid=19291): stderr: | 20221208220659917 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220659917 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220659917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220659918 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220659918 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220659918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220659918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:01.491334 run osmo-stp_10.42.42.5(pid=19291): stdout: | (launched: 2022-12-08_22:06:59.722255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:01.627408 run osmo-stp_10.42.42.5(pid=19291): stderr: | 20221208220659917 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220659917 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220659917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220659918 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220659918 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220659918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220659918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:01.788420 run patchelf(pid=19294): Terminating (SIGINT) 22:07:01.973794 run patchelf(pid=19294): Terminated: ok {rc=0} 22:07:02.106460 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19291): Process ended prematurely: osmo-stp_10.42.42.5(pid=19291) [trial-2350↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19291)] [trial-2350↪gprs:trx-b200↪iperf3.py:8] 22:07:02.117187 tst iperf3.py:8: Test FAILED (7.6 sec) 22:07:02.146661 run osmo-hlr_10.42.42.2(pid=19288): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19288)] 22:07:02.197571 run osmo-hlr_10.42.42.2(pid=19288): stdout: | (launched: 2022-12-08_22:06:58.715009) 22:07:02.250063 run osmo-hlr_10.42.42.2(pid=19288): stderr: | 20221208220658910 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220658910 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220658910 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220658910 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220658910 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220658910 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220658922 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220658931 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220658931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220658931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:07:02.302725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19283): Terminating (SIGTERM) 22:07:02.345486 run iperf3-srv_10.42.42.10(pid=19284): Terminating (SIGTERM) 22:07:02.387885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19287): Terminating (SIGTERM) 22:07:02.430306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19290): Terminating (SIGTERM) 22:07:02.472696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19293): Terminating (SIGTERM) 22:07:02.515759 --- ParallelTerminationStrategy: PID 19283 died... 22:07:02.535971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19283): Terminated: ok {rc=0} 22:07:02.582955 --- ParallelTerminationStrategy: PID 19284 died... 22:07:02.602861 run iperf3-srv_10.42.42.10(pid=19284): Terminated {rc=256} 22:07:02.649693 --- ParallelTerminationStrategy: PID 19287 died... 22:07:02.669446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19287): Terminated: ok {rc=0} 22:07:02.716128 --- ParallelTerminationStrategy: PID 19290 died... 22:07:02.735900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19290): Terminated: ok {rc=0} 22:07:02.782631 --- ParallelTerminationStrategy: PID 19293 died... 22:07:02.802415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19293): Terminated: ok {rc=0} 22:07:02.891754 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 22:07:04.042055 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:04.053792 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 22:07:04.104061 tst iperf3m4.py: using LAC 17064 22:07:04.232340 tst iperf3m4.py: using RAC 234 22:07:04.359118 tst iperf3m4.py: using CellId 17064 22:07:04.485719 tst iperf3m4.py: using BVCI 17065 22:07:04.598372 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:04.609274 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:04.619734 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:04.630990 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:04.642248 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:04.653423 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:04.664784 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:04.675968 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:04.687408 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:07:04.805433 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:07:04.921708 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:07:05.040650 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:07:05.162121 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:07:05.381889 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:07:05.707152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19295): Launched 22:07:05.988029 run iperf3-srv_10.42.42.10(pid=19296): Launched 22:07:06.110177 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:07:06.327879 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:07:06.652269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19297): Launched 22:07:06.931529 run iperf3-srv_10.42.42.10(pid=19298): Launched 22:07:07.052896 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:07:07.270791 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:07:07.595513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19299): Launched 22:07:07.875935 run iperf3-srv_10.42.42.10(pid=19300): Launched 22:07:07.997052 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:07:08.214361 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:07:08.538645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19301): Launched 22:07:08.818466 run iperf3-srv_10.42.42.10(pid=19302): Launched 22:07:08.939106 tst iperf3m4.py:8: start network... 22:07:09.156677 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:07:09.660251 run create_hlr_db(pid=19303): Launched 22:07:09.791426 bus /gobi_6: Setting Powered False 22:07:10.855455 run create_hlr_db(pid=19303): Terminated: ok {rc=0} 22:07:11.287483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19305): Launched 22:07:11.591828 run osmo-hlr_10.42.42.2(pid=19306): Launched 22:07:11.708019 run osmo-stp_10.42.42.5: Starting osmo-stp 22:07:12.241673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19308): Launched 22:07:12.545991 run osmo-stp_10.42.42.5(pid=19309): Launched 22:07:12.661177 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:07:13.182530 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19311): Launched 22:07:13.298480 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:07:13.554787 run patchelf(pid=19312): Launched 22:07:13.723477 run osmo-stp_10.42.42.5(pid=19309): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19309)] 22:07:13.852542 run osmo-stp_10.42.42.5(pid=19309): stdout: | (launched: 2022-12-08_22:07:12.490747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:13.983040 run osmo-stp_10.42.42.5(pid=19309): stderr: | 20221208220712661 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220712662 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220712662 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220712662 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220712663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220712663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220712663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:14.113962 run osmo-stp_10.42.42.5(pid=19309): stdout: | (launched: 2022-12-08_22:07:12.490747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:14.239921 run osmo-stp_10.42.42.5(pid=19309): stderr: | 20221208220712661 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220712662 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220712662 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220712662 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220712663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220712663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220712663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:14.388868 run patchelf(pid=19312): Terminating (SIGINT) 22:07:14.560349 run patchelf(pid=19312): Terminated: ok {rc=0} 22:07:14.683909 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19309): Process ended prematurely: osmo-stp_10.42.42.5(pid=19309) [trial-2350↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19309)] [trial-2350↪gprs:trx-b200↪iperf3m4.py:8] 22:07:14.693488 tst iperf3m4.py:8: Test FAILED (10.7 sec) 22:07:14.721935 run osmo-hlr_10.42.42.2(pid=19306): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19306)] 22:07:14.770972 run osmo-hlr_10.42.42.2(pid=19306): stdout: | (launched: 2022-12-08_22:07:11.536936) 22:07:14.821766 run osmo-hlr_10.42.42.2(pid=19306): stderr: | 20221208220711711 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220711712 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220711712 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220711712 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220711712 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220711712 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220711725 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220711733 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220711733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220711733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:07:14.873202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19295): Terminating (SIGTERM) 22:07:14.914159 run iperf3-srv_10.42.42.10(pid=19296): Terminating (SIGTERM) 22:07:14.955101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19297): Terminating (SIGTERM) 22:07:14.996168 run iperf3-srv_10.42.42.10(pid=19298): Terminating (SIGTERM) 22:07:15.037373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19299): Terminating (SIGTERM) 22:07:15.078591 run iperf3-srv_10.42.42.10(pid=19300): Terminating (SIGTERM) 22:07:15.119605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19301): Terminating (SIGTERM) 22:07:15.160603 run iperf3-srv_10.42.42.10(pid=19302): Terminating (SIGTERM) 22:07:15.201244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19305): Terminating (SIGTERM) 22:07:15.242124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19308): Terminating (SIGTERM) 22:07:15.282922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19311): Terminating (SIGTERM) 22:07:15.324208 --- ParallelTerminationStrategy: PID 19295 died... 22:07:15.343670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19295): Terminated: ok {rc=0} 22:07:15.390098 --- ParallelTerminationStrategy: PID 19296 died... 22:07:15.409146 run iperf3-srv_10.42.42.10(pid=19296): Terminated {rc=256} 22:07:15.454825 --- ParallelTerminationStrategy: PID 19297 died... 22:07:15.473872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19297): Terminated: ok {rc=0} 22:07:15.519268 --- ParallelTerminationStrategy: PID 19298 died... 22:07:15.538165 run iperf3-srv_10.42.42.10(pid=19298): Terminated {rc=256} 22:07:15.584204 --- ParallelTerminationStrategy: PID 19299 died... 22:07:15.603228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19299): Terminated: ok {rc=0} 22:07:15.648816 --- ParallelTerminationStrategy: PID 19300 died... 22:07:15.668052 run iperf3-srv_10.42.42.10(pid=19300): Terminated {rc=256} 22:07:15.713499 --- ParallelTerminationStrategy: PID 19301 died... 22:07:15.732485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19301): Terminated: ok {rc=0} 22:07:15.778141 --- ParallelTerminationStrategy: PID 19302 died... 22:07:15.797151 run iperf3-srv_10.42.42.10(pid=19302): Terminated {rc=256} 22:07:15.863782 --- ParallelTerminationStrategy: PID 19305 died... 22:07:15.890848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19305): Terminated: ok {rc=0} 22:07:15.942181 --- ParallelTerminationStrategy: PID 19308 died... 22:07:15.962866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19308): Terminated: ok {rc=0} 22:07:16.011196 --- ParallelTerminationStrategy: PID 19311 died... 22:07:16.032660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19311): Terminated: ok {rc=0} 22:07:16.125650 bus /gobi_4: Setting Powered False 22:07:17.233893 bus /gobi_4: Setting Powered False 22:07:18.352562 bus /gobi_1: Setting Powered False 22:07:19.451354 bus /gobi_1: Setting Powered False 22:07:20.568174 bus /gobi_0: Setting Powered False 22:07:21.668596 bus /gobi_0: Setting Powered False 22:07:22.787988 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-b200 ping.py ---------------------------------------------- 22:07:23.894399 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:23.905665 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 22:07:23.954096 tst ping.py: using LAC 17065 22:07:24.073766 tst ping.py: using RAC 235 22:07:24.191911 tst ping.py: using CellId 17065 22:07:24.310736 tst ping.py: using BVCI 17066 22:07:24.421274 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:24.431680 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:24.442187 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:24.452678 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:24.463303 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:24.473930 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:24.484701 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:24.495288 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:07:24.612123 tst ping.py:19: start network... 22:07:24.826380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:07:25.316517 run create_hlr_db(pid=19313): Launched 22:07:25.445785 bus /gobi_6: Setting Powered False 22:07:26.510764 run create_hlr_db(pid=19313): Terminated: ok {rc=0} 22:07:26.937678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19315): Launched 22:07:27.235948 run osmo-hlr_10.42.42.2(pid=19316): Launched 22:07:27.349002 run osmo-stp_10.42.42.5: Starting osmo-stp 22:07:27.880862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19318): Launched 22:07:28.177296 run osmo-stp_10.42.42.5(pid=19319): Launched 22:07:28.289978 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:07:28.800892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19321): Launched 22:07:28.914941 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:07:29.166085 run patchelf(pid=19322): Launched 22:07:29.331560 run osmo-stp_10.42.42.5(pid=19319): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19319)] 22:07:29.458507 run osmo-stp_10.42.42.5(pid=19319): stdout: | (launched: 2022-12-08_22:07:28.123268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:29.587068 run osmo-stp_10.42.42.5(pid=19319): stderr: | 20221208220728292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220728292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220728292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220728293 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220728293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220728293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220728293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:29.715762 run osmo-stp_10.42.42.5(pid=19319): stdout: | (launched: 2022-12-08_22:07:28.123268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:29.838361 run osmo-stp_10.42.42.5(pid=19319): stderr: | 20221208220728292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220728292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220728292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220728293 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220728293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220728293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220728293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:29.983957 run patchelf(pid=19322): Terminating (SIGINT) 22:07:30.151968 run patchelf(pid=19322): Terminated: ok {rc=0} 22:07:30.272785 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19319): Process ended prematurely: osmo-stp_10.42.42.5(pid=19319) [trial-2350↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19319)] [trial-2350↪gprs:trx-b200↪ping.py:22] 22:07:30.281795 tst ping.py:22: Test FAILED (6.4 sec) 22:07:30.309203 run osmo-hlr_10.42.42.2(pid=19316): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19316)] 22:07:30.358382 run osmo-hlr_10.42.42.2(pid=19316): stdout: | (launched: 2022-12-08_22:07:27.181602) 22:07:30.409382 run osmo-hlr_10.42.42.2(pid=19316): stderr: | 20221208220727358 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220727358 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220727358 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220727358 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220727358 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220727358 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220727370 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220727379 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220727380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220727380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:07:30.461316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19315): Terminating (SIGTERM) 22:07:30.502253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19318): Terminating (SIGTERM) 22:07:30.543141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19321): Terminating (SIGTERM) 22:07:30.584333 --- ParallelTerminationStrategy: PID 19315 died... 22:07:30.603755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19315): Terminated: ok {rc=0} 22:07:30.649670 --- ParallelTerminationStrategy: PID 19318 died... 22:07:30.668668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19318): Terminated: ok {rc=0} 22:07:30.714288 --- ParallelTerminationStrategy: PID 19321 died... 22:07:30.733231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19321): Terminated: ok {rc=0} 22:07:30.820680 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 22:07:31.934402 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:31.946123 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 22:07:31.996178 tst ping_idle_ping.py: using LAC 17066 22:07:32.155259 tst ping_idle_ping.py: using RAC 236 22:07:32.279397 tst ping_idle_ping.py: using CellId 17066 22:07:32.394738 tst ping_idle_ping.py: using BVCI 17067 22:07:32.503459 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:32.514076 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:32.524628 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:32.535402 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:32.546009 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:32.556503 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:32.567194 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:32.578084 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:07:32.692000 tst ping_idle_ping.py:24: start network... 22:07:32.907071 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:07:33.401778 run create_hlr_db(pid=19323): Launched 22:07:33.531653 bus /gobi_6: Setting Powered False 22:07:34.594903 run create_hlr_db(pid=19323): Terminated: ok {rc=0} 22:07:35.040053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19325): Launched 22:07:35.357171 run osmo-hlr_10.42.42.2(pid=19326): Launched 22:07:35.477511 run osmo-stp_10.42.42.5: Starting osmo-stp 22:07:36.012229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19330): Launched 22:07:36.309788 run osmo-stp_10.42.42.5(pid=19331): Launched 22:07:36.423973 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:07:36.941050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19333): Launched 22:07:37.055656 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:07:37.308694 run patchelf(pid=19334): Launched 22:07:37.475481 run osmo-stp_10.42.42.5(pid=19331): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19331)] 22:07:37.604089 run osmo-stp_10.42.42.5(pid=19331): stdout: | (launched: 2022-12-08_22:07:36.255821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:37.733447 run osmo-stp_10.42.42.5(pid=19331): stderr: | 20221208220736425 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220736425 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220736425 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220736426 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220736426 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220736426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220736426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:37.862693 run osmo-stp_10.42.42.5(pid=19331): stdout: | (launched: 2022-12-08_22:07:36.255821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:37.985960 run osmo-stp_10.42.42.5(pid=19331): stderr: | 20221208220736425 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220736425 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220736425 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220736426 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220736426 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220736426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220736426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:38.132096 run patchelf(pid=19334): Terminating (SIGINT) 22:07:38.301519 run patchelf(pid=19334): Terminated: ok {rc=0} 22:07:38.423505 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19331): Process ended prematurely: osmo-stp_10.42.42.5(pid=19331) [trial-2350↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19331)] [trial-2350↪gprs:trx-b200↪ping_idle_ping.py:27] 22:07:38.432502 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 22:07:38.460202 run osmo-hlr_10.42.42.2(pid=19326): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19326)] 22:07:38.509355 run osmo-hlr_10.42.42.2(pid=19326): stdout: | (launched: 2022-12-08_22:07:35.300028) 22:07:38.559878 run osmo-hlr_10.42.42.2(pid=19326): stderr: | 20221208220735496 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220735496 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220735496 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220735496 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220735496 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220735496 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220735511 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220735522 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220735522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220735522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:07:38.610925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19325): Terminating (SIGTERM) 22:07:38.652016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19330): Terminating (SIGTERM) 22:07:38.693050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19333): Terminating (SIGTERM) 22:07:38.734054 --- ParallelTerminationStrategy: PID 19325 died... 22:07:38.753477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19325): Terminated: ok {rc=0} 22:07:38.798959 --- ParallelTerminationStrategy: PID 19330 died... 22:07:38.817931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19330): Terminated: ok {rc=0} 22:07:38.863469 --- ParallelTerminationStrategy: PID 19333 died... 22:07:38.882353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19333): Terminated: ok {rc=0} 22:07:38.970043 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 22:07:40.281647 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:07:40.287382 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:07:40.321484 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:07:40.360896 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:07:40.447351 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:07:40.480867 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:07:40.519927 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:07:41.114920 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:07:41.167396 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:41.179051 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:07:41.228823 tst cs_paging_gprs_active.py: using LAC 17067 22:07:41.354266 tst cs_paging_gprs_active.py: using RAC 237 22:07:41.480460 tst cs_paging_gprs_active.py: using CellId 17067 22:07:41.606179 tst cs_paging_gprs_active.py: using BVCI 17068 22:07:41.725163 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:41.736591 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:41.747783 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:41.759163 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:41.770526 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:41.781851 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:41.793409 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:41.804642 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:41.816160 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:07:41.931196 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:07:42.049456 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:07:42.268907 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:07:42.593743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19338): Launched 22:07:42.875423 run iperf3-srv_10.42.42.10(pid=19339): Launched 22:07:42.997729 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:07:43.216403 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:07:43.525600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19340): Launched 22:07:43.792609 run iperf3-srv_10.42.42.10(pid=19341): Launched 22:07:43.906533 tst cs_paging_gprs_active.py:38: start network... 22:07:44.109693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:07:44.579903 run create_hlr_db(pid=19342): Launched 22:07:44.697344 bus /gobi_6: Setting Powered False 22:07:45.758344 run create_hlr_db(pid=19342): Terminated: ok {rc=0} 22:07:46.223559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19344): Launched 22:07:46.553308 run osmo-hlr_10.42.42.2(pid=19345): Launched 22:07:46.886432 run osmo-stp_10.42.42.5: Starting osmo-stp 22:07:47.427508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19347): Launched 22:07:47.730865 run osmo-stp_10.42.42.5(pid=19348): Launched 22:07:47.846306 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:07:48.368383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19350): Launched 22:07:48.484426 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:07:48.740796 run patchelf(pid=19351): Launched 22:07:48.910070 run osmo-stp_10.42.42.5(pid=19348): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19348)] 22:07:49.038971 run osmo-stp_10.42.42.5(pid=19348): stdout: | (launched: 2022-12-08_22:07:47.676151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:49.169597 run osmo-stp_10.42.42.5(pid=19348): stderr: | 20221208220747843 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220747843 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220747843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220747843 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220747846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220747846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220747846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:49.300414 run osmo-stp_10.42.42.5(pid=19348): stdout: | (launched: 2022-12-08_22:07:47.676151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:49.425977 run osmo-stp_10.42.42.5(pid=19348): stderr: | 20221208220747843 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220747843 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220747843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220747843 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220747846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220747846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220747846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:49.574968 run patchelf(pid=19351): Terminating (SIGINT) 22:07:49.746436 run patchelf(pid=19351): Terminated: ok {rc=0} 22:07:49.869921 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19348): Process ended prematurely: osmo-stp_10.42.42.5(pid=19348) [trial-2350↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19348)] [trial-2350↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:07:49.879427 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 22:07:49.907367 run osmo-hlr_10.42.42.2(pid=19345): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19345)] 22:07:49.956076 run osmo-hlr_10.42.42.2(pid=19345): stdout: | (launched: 2022-12-08_22:07:46.487903) 22:07:50.006615 run osmo-hlr_10.42.42.2(pid=19345): stderr: | 20221208220746710 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220746710 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220746710 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220746710 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220746710 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220746710 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220746729 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220746738 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220746738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220746738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:07:50.057502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19338): Terminating (SIGTERM) 22:07:50.098275 run iperf3-srv_10.42.42.10(pid=19339): Terminating (SIGTERM) 22:07:50.138807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19340): Terminating (SIGTERM) 22:07:50.179410 run iperf3-srv_10.42.42.10(pid=19341): Terminating (SIGTERM) 22:07:50.219876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19344): Terminating (SIGTERM) 22:07:50.260412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19347): Terminating (SIGTERM) 22:07:50.301027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19350): Terminating (SIGTERM) 22:07:50.341761 --- ParallelTerminationStrategy: PID 19338 died... 22:07:50.361137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19338): Terminated: ok {rc=0} 22:07:50.406445 --- ParallelTerminationStrategy: PID 19339 died... 22:07:50.425204 run iperf3-srv_10.42.42.10(pid=19339): Terminated {rc=256} 22:07:50.469922 --- ParallelTerminationStrategy: PID 19340 died... 22:07:50.488704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19340): Terminated: ok {rc=0} 22:07:50.534110 --- ParallelTerminationStrategy: PID 19341 died... 22:07:50.552893 run iperf3-srv_10.42.42.10(pid=19341): Terminated {rc=256} 22:07:50.598094 --- ParallelTerminationStrategy: PID 19344 died... 22:07:50.616714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19344): Terminated: ok {rc=0} 22:07:50.662179 --- ParallelTerminationStrategy: PID 19347 died... 22:07:50.681089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19347): Terminated: ok {rc=0} 22:07:50.726734 --- ParallelTerminationStrategy: PID 19350 died... 22:07:50.745520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19350): Terminated: ok {rc=0} 22:07:50.832145 bus /gobi_0: Setting Powered False 22:07:51.932042 bus /gobi_0: Setting Powered False 22:07:53.047691 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:07:54.193864 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:54.205285 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:07:54.257604 tst iperf3.py: using LAC 17068 22:07:54.386579 tst iperf3.py: using RAC 238 22:07:54.516215 tst iperf3.py: using CellId 17068 22:07:54.647767 tst iperf3.py: using BVCI 17069 22:07:54.768811 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:54.780275 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:54.791434 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:54.802851 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:54.814255 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:54.825583 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:54.837076 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:54.848096 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:54.859545 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:07:54.975299 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:07:55.179986 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:07:55.484680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19352): Launched 22:07:55.748712 run iperf3-srv_10.42.42.10(pid=19353): Launched 22:07:55.862721 tst iperf3.py:8: start network... 22:07:56.065823 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:07:56.534008 run create_hlr_db(pid=19354): Launched 22:07:56.649993 bus /gobi_6: Setting Powered False 22:07:57.711040 run create_hlr_db(pid=19354): Terminated: ok {rc=0} 22:07:58.132920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19356): Launched 22:07:58.434660 run osmo-hlr_10.42.42.2(pid=19357): Launched 22:07:58.549998 run osmo-stp_10.42.42.5: Starting osmo-stp 22:07:59.088798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19359): Launched 22:07:59.390461 run osmo-stp_10.42.42.5(pid=19360): Launched 22:07:59.506446 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:08:00.027320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19362): Launched 22:08:00.143301 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:08:00.399033 run patchelf(pid=19363): Launched 22:08:00.567790 run osmo-stp_10.42.42.5(pid=19360): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19360)] 22:08:00.696896 run osmo-stp_10.42.42.5(pid=19360): stdout: | (launched: 2022-12-08_22:07:59.335931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:00.827893 run osmo-stp_10.42.42.5(pid=19360): stderr: | 20221208220759505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220759505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220759506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220759506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220759506 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220759507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220759507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:00.960777 run osmo-stp_10.42.42.5(pid=19360): stdout: | (launched: 2022-12-08_22:07:59.335931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:01.088296 run osmo-stp_10.42.42.5(pid=19360): stderr: | 20221208220759505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220759505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220759506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220759506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220759506 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220759507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220759507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:01.269129 run patchelf(pid=19363): Terminating (SIGINT) 22:08:01.470479 run patchelf(pid=19363): Terminated: ok {rc=0} 22:08:01.610228 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19360): Process ended prematurely: osmo-stp_10.42.42.5(pid=19360) [trial-2350↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19360)] [trial-2350↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 22:08:01.620336 tst iperf3.py:8: Test FAILED (7.5 sec) 22:08:01.653571 run osmo-hlr_10.42.42.2(pid=19357): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19357)] 22:08:01.703372 run osmo-hlr_10.42.42.2(pid=19357): stdout: | (launched: 2022-12-08_22:07:58.380157) 22:08:01.754758 run osmo-hlr_10.42.42.2(pid=19357): stderr: | 20221208220758556 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220758556 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220758556 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220758556 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220758556 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220758556 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220758568 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220758576 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220758576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220758577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:08:01.806650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19352): Terminating (SIGTERM) 22:08:01.848554 run iperf3-srv_10.42.42.10(pid=19353): Terminating (SIGTERM) 22:08:01.893169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19356): Terminating (SIGTERM) 22:08:01.935990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19359): Terminating (SIGTERM) 22:08:01.984261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19362): Terminating (SIGTERM) 22:08:02.038058 --- ParallelTerminationStrategy: PID 19352 died... 22:08:02.062744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19352): Terminated: ok {rc=0} 22:08:02.110023 --- ParallelTerminationStrategy: PID 19353 died... 22:08:02.129455 run iperf3-srv_10.42.42.10(pid=19353): Terminated {rc=256} 22:08:02.175512 --- ParallelTerminationStrategy: PID 19356 died... 22:08:02.194717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19356): Terminated: ok {rc=0} 22:08:02.240691 --- ParallelTerminationStrategy: PID 19359 died... 22:08:02.259991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19359): Terminated: ok {rc=0} 22:08:02.306020 --- ParallelTerminationStrategy: PID 19362 died... 22:08:02.325356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19362): Terminated: ok {rc=0} 22:08:02.424129 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:08:03.617298 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:03.634717 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:08:03.693413 tst iperf3m4.py: using LAC 17069 22:08:03.840672 tst iperf3m4.py: using RAC 239 22:08:03.971291 tst iperf3m4.py: using CellId 17069 22:08:04.132733 tst iperf3m4.py: using BVCI 17070 22:08:04.255833 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:04.267992 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:04.280032 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:04.292534 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:04.306356 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:04.319315 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:04.332486 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:04.345743 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:04.358716 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:08:04.483177 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:08:04.612615 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:08:04.739011 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:08:04.864177 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:08:05.090420 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:08:05.430187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19635): Launched 22:08:05.734897 run iperf3-srv_10.42.42.10(pid=19636): Launched 22:08:05.873685 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:08:06.096870 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:08:06.441679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19639): Launched 22:08:06.725731 run iperf3-srv_10.42.42.10(pid=19640): Launched 22:08:06.859209 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:08:07.081868 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:08:07.417523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19641): Launched 22:08:07.720477 run iperf3-srv_10.42.42.10(pid=19642): Launched 22:08:07.857259 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:08:08.079471 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:08:08.415579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19643): Launched 22:08:08.720332 run iperf3-srv_10.42.42.10(pid=19644): Launched 22:08:08.857256 tst iperf3m4.py:8: start network... 22:08:09.082147 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:08:09.606953 run create_hlr_db(pid=19645): Launched 22:08:09.778328 bus /gobi_6: Setting Powered False 22:08:10.844557 run create_hlr_db(pid=19645): Terminated: ok {rc=0} 22:08:11.324857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19647): Launched 22:08:11.670286 run osmo-hlr_10.42.42.2(pid=19648): Launched 22:08:11.928515 run osmo-stp_10.42.42.5: Starting osmo-stp 22:08:12.606445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19650): Launched 22:08:12.959051 run osmo-stp_10.42.42.5(pid=19651): Launched 22:08:13.211891 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:08:13.881649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19653): Launched 22:08:14.013693 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:08:14.313759 run patchelf(pid=19654): Launched 22:08:14.507674 run osmo-stp_10.42.42.5(pid=19651): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19651)] 22:08:14.650289 run osmo-stp_10.42.42.5(pid=19651): stdout: | (launched: 2022-12-08_22:08:12.891649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:14.795396 run osmo-stp_10.42.42.5(pid=19651): stderr: | 20221208220813195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220813196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220813196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220813196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220813201 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220813201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220813201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:14.939995 run osmo-stp_10.42.42.5(pid=19651): stdout: | (launched: 2022-12-08_22:08:12.891649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:15.077829 run osmo-stp_10.42.42.5(pid=19651): stderr: | 20221208220813195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220813196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220813196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220813196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220813201 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220813201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220813201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:15.243611 run patchelf(pid=19654): Terminating (SIGINT) 22:08:15.433663 run patchelf(pid=19654): Terminated: ok {rc=0} 22:08:15.570236 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19651): Process ended prematurely: osmo-stp_10.42.42.5(pid=19651) [trial-2350↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19651)] [trial-2350↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 22:08:15.581946 tst iperf3m4.py:8: Test FAILED (12.0 sec) 22:08:15.613680 run osmo-hlr_10.42.42.2(pid=19648): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19648)] 22:08:15.667555 run osmo-hlr_10.42.42.2(pid=19648): stdout: | (launched: 2022-12-08_22:08:11.602909) 22:08:15.723506 run osmo-hlr_10.42.42.2(pid=19648): stderr: | 20221208220811924 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220811924 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220811924 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220811924 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220811924 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220811924 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220811939 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220811955 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220811955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220811956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:08:15.778753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19635): Terminating (SIGTERM) 22:08:15.825889 run iperf3-srv_10.42.42.10(pid=19636): Terminating (SIGTERM) 22:08:15.905226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19639): Terminating (SIGTERM) 22:08:15.967287 run iperf3-srv_10.42.42.10(pid=19640): Terminating (SIGTERM) 22:08:16.023587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19641): Terminating (SIGTERM) 22:08:16.069060 run iperf3-srv_10.42.42.10(pid=19642): Terminating (SIGTERM) 22:08:16.118264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19643): Terminating (SIGTERM) 22:08:16.163523 run iperf3-srv_10.42.42.10(pid=19644): Terminating (SIGTERM) 22:08:16.210213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19647): Terminating (SIGTERM) 22:08:16.256938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19650): Terminating (SIGTERM) 22:08:16.306358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19653): Terminating (SIGTERM) 22:08:16.357665 --- ParallelTerminationStrategy: PID 19635 died... 22:08:16.382273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19635): Terminated: ok {rc=0} 22:08:16.441330 --- ParallelTerminationStrategy: PID 19636 died... 22:08:16.465543 run iperf3-srv_10.42.42.10(pid=19636): Terminated {rc=256} 22:08:16.523776 --- ParallelTerminationStrategy: PID 19639 died... 22:08:16.548063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19639): Terminated: ok {rc=0} 22:08:16.607466 --- ParallelTerminationStrategy: PID 19640 died... 22:08:16.631573 run iperf3-srv_10.42.42.10(pid=19640): Terminated {rc=256} 22:08:16.688808 --- ParallelTerminationStrategy: PID 19641 died... 22:08:16.714533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19641): Terminated: ok {rc=0} 22:08:16.771668 --- ParallelTerminationStrategy: PID 19642 died... 22:08:16.795631 run iperf3-srv_10.42.42.10(pid=19642): Terminated {rc=256} 22:08:16.851218 --- ParallelTerminationStrategy: PID 19643 died... 22:08:16.876001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19643): Terminated: ok {rc=0} 22:08:16.937772 --- ParallelTerminationStrategy: PID 19644 died... 22:08:16.970636 run iperf3-srv_10.42.42.10(pid=19644): Terminated {rc=256} 22:08:17.058955 --- ParallelTerminationStrategy: PID 19647 died... 22:08:17.085512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19647): Terminated: ok {rc=0} 22:08:17.140125 --- ParallelTerminationStrategy: PID 19650 died... 22:08:17.163125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19650): Terminated: ok {rc=0} 22:08:17.217667 --- ParallelTerminationStrategy: PID 19653 died... 22:08:17.244659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19653): Terminated: ok {rc=0} 22:08:17.354315 bus /gobi_4: Setting Powered False 22:08:18.464387 bus /gobi_4: Setting Powered False 22:08:19.588053 bus /gobi_1: Setting Powered False 22:08:20.693212 bus /gobi_1: Setting Powered False 22:08:21.817328 bus /gobi_0: Setting Powered False 22:08:22.923058 bus /gobi_0: Setting Powered False 22:08:24.045703 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 22:08:25.161193 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:25.172680 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:08:25.224386 tst ping.py: using LAC 17070 22:08:25.343371 tst ping.py: using RAC 240 22:08:25.462577 tst ping.py: using CellId 17070 22:08:25.582351 tst ping.py: using BVCI 17071 22:08:25.691395 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:25.702247 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:25.712821 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:25.723694 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:25.735247 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:25.746425 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:25.757728 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:25.768777 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:08:25.882910 tst ping.py:19: start network... 22:08:26.082197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:08:26.543057 run create_hlr_db(pid=19655): Launched 22:08:26.655902 bus /gobi_6: Setting Powered False 22:08:27.716390 run create_hlr_db(pid=19655): Terminated: ok {rc=0} 22:08:28.154499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19657): Launched 22:08:28.472335 run osmo-hlr_10.42.42.2(pid=19658): Launched 22:08:28.594620 run osmo-stp_10.42.42.5: Starting osmo-stp 22:08:29.149030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19660): Launched 22:08:29.464333 run osmo-stp_10.42.42.5(pid=19661): Launched 22:08:29.585171 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:08:30.136118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19663): Launched 22:08:30.257825 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:08:30.526688 run patchelf(pid=19664): Launched 22:08:30.704540 run osmo-stp_10.42.42.5(pid=19661): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19661)] 22:08:30.849103 run osmo-stp_10.42.42.5(pid=19661): stdout: | (launched: 2022-12-08_22:08:29.407550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:30.988102 run osmo-stp_10.42.42.5(pid=19661): stderr: | 20221208220829599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220829600 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220829600 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220829600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220829601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220829601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220829601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:31.122284 run osmo-stp_10.42.42.5(pid=19661): stdout: | (launched: 2022-12-08_22:08:29.407550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:31.248534 run osmo-stp_10.42.42.5(pid=19661): stderr: | 20221208220829599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220829600 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220829600 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220829600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220829601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220829601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220829601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:31.399134 run patchelf(pid=19664): Terminating (SIGINT) 22:08:31.573250 run patchelf(pid=19664): Terminated: ok {rc=0} 22:08:31.700540 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19661): Process ended prematurely: osmo-stp_10.42.42.5(pid=19661) [trial-2350↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19661)] [trial-2350↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 22:08:31.710596 tst ping.py:22: Test FAILED (6.5 sec) 22:08:31.740223 run osmo-hlr_10.42.42.2(pid=19658): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19658)] 22:08:31.793048 run osmo-hlr_10.42.42.2(pid=19658): stdout: | (launched: 2022-12-08_22:08:28.415161) 22:08:31.846968 run osmo-hlr_10.42.42.2(pid=19658): stderr: | 20221208220828613 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220828613 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220828613 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220828613 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220828613 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220828613 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220828626 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220828634 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220828634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220828634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:08:31.902116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19657): Terminating (SIGTERM) 22:08:31.945845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19660): Terminating (SIGTERM) 22:08:31.991331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19663): Terminating (SIGTERM) 22:08:32.037103 --- ParallelTerminationStrategy: PID 19657 died... 22:08:32.057841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19657): Terminated: ok {rc=0} 22:08:32.109711 --- ParallelTerminationStrategy: PID 19660 died... 22:08:32.130237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19660): Terminated: ok {rc=0} 22:08:32.178998 --- ParallelTerminationStrategy: PID 19663 died... 22:08:32.198914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19663): Terminated: ok {rc=0} 22:08:32.288450 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:08:33.377770 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:33.389824 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:08:33.442971 tst ping_idle_ping.py: using LAC 17071 22:08:33.568479 tst ping_idle_ping.py: using RAC 241 22:08:33.693027 tst ping_idle_ping.py: using CellId 17071 22:08:33.818054 tst ping_idle_ping.py: using BVCI 17072 22:08:33.933955 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:33.945315 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:33.956329 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:33.967432 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:33.978582 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:33.989631 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:34.001079 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:34.012232 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:08:34.129776 tst ping_idle_ping.py:24: start network... 22:08:34.343869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:08:34.838289 run create_hlr_db(pid=19665): Launched 22:08:34.966645 bus /gobi_6: Setting Powered False 22:08:36.030254 run create_hlr_db(pid=19665): Terminated: ok {rc=0} 22:08:36.475491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19667): Launched 22:08:36.793496 run osmo-hlr_10.42.42.2(pid=19668): Launched 22:08:36.914391 run osmo-stp_10.42.42.5: Starting osmo-stp 22:08:37.465103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19670): Launched 22:08:37.783992 run osmo-stp_10.42.42.5(pid=19671): Launched 22:08:37.905376 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:08:38.456482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19673): Launched 22:08:38.578844 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:08:38.848783 run patchelf(pid=19674): Launched 22:08:39.026953 run osmo-stp_10.42.42.5(pid=19671): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19671)] 22:08:39.162981 run osmo-stp_10.42.42.5(pid=19671): stdout: | (launched: 2022-12-08_22:08:37.726632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:39.300132 run osmo-stp_10.42.42.5(pid=19671): stderr: | 20221208220837918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220837918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220837918 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220837919 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220837919 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220837919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220837919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:39.437529 run osmo-stp_10.42.42.5(pid=19671): stdout: | (launched: 2022-12-08_22:08:37.726632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:39.569091 run osmo-stp_10.42.42.5(pid=19671): stderr: | 20221208220837918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220837918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220837918 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220837919 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220837919 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220837919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220837919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:39.725235 run patchelf(pid=19674): Terminating (SIGINT) 22:08:39.905370 run patchelf(pid=19674): Terminated: ok {rc=0} 22:08:40.035002 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19671): Process ended prematurely: osmo-stp_10.42.42.5(pid=19671) [trial-2350↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19671)] [trial-2350↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 22:08:40.044776 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 22:08:40.073753 run osmo-hlr_10.42.42.2(pid=19668): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19668)] 22:08:40.125100 run osmo-hlr_10.42.42.2(pid=19668): stdout: | (launched: 2022-12-08_22:08:36.736302) 22:08:40.178286 run osmo-hlr_10.42.42.2(pid=19668): stderr: | 20221208220836935 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220836935 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220836935 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220836935 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220836935 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220836935 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220836948 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220836958 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220836958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220836958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:08:40.231724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19667): Terminating (SIGTERM) 22:08:40.274522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19670): Terminating (SIGTERM) 22:08:40.317366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19673): Terminating (SIGTERM) 22:08:40.360348 --- ParallelTerminationStrategy: PID 19667 died... 22:08:40.380824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19667): Terminated: ok {rc=0} 22:08:40.428309 --- ParallelTerminationStrategy: PID 19670 died... 22:08:40.448364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19670): Terminated: ok {rc=0} 22:08:40.495363 --- ParallelTerminationStrategy: PID 19673 died... 22:08:40.515415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19673): Terminated: ok {rc=0} 22:08:40.604555 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:08:41.916442 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:08:41.923299 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:08:41.957413 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:08:41.996578 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:08:42.084284 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:08:42.117596 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:08:42.156154 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:08:42.752129 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:08:42.803776 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:42.814987 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:08:42.886685 tst cs_paging_gprs_active.py: using LAC 17072 22:08:43.015390 tst cs_paging_gprs_active.py: using RAC 242 22:08:43.144318 tst cs_paging_gprs_active.py: using CellId 17072 22:08:43.277372 tst cs_paging_gprs_active.py: using BVCI 17073 22:08:43.397458 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:43.408613 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:43.419649 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:43.430706 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:43.441660 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:43.453309 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:43.464309 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:43.475278 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:43.486489 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:08:43.602467 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:08:43.716169 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:08:43.921198 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:08:44.226770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19680): Launched 22:08:44.490635 run iperf3-srv_10.42.42.10(pid=19681): Launched 22:08:44.605347 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:08:44.809368 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:08:45.114393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19682): Launched 22:08:45.378586 run iperf3-srv_10.42.42.10(pid=19683): Launched 22:08:45.492654 tst cs_paging_gprs_active.py:38: start network... 22:08:45.696088 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:08:46.179969 run create_hlr_db(pid=19684): Launched 22:08:46.328566 bus /gobi_6: Setting Powered False 22:08:47.392826 run create_hlr_db(pid=19684): Terminated: ok {rc=0} 22:08:47.853683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19686): Launched 22:08:48.158281 run osmo-hlr_10.42.42.2(pid=19687): Launched 22:08:48.273560 run osmo-stp_10.42.42.5: Starting osmo-stp 22:08:48.809510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19689): Launched 22:08:49.114169 run osmo-stp_10.42.42.5(pid=19690): Launched 22:08:49.230037 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:08:49.753640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19692): Launched 22:08:49.871108 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:08:50.129366 run patchelf(pid=19693): Launched 22:08:50.299499 run osmo-stp_10.42.42.5(pid=19690): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19690)] 22:08:50.429180 run osmo-stp_10.42.42.5(pid=19690): stdout: | (launched: 2022-12-08_22:08:49.058399) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:50.560526 run osmo-stp_10.42.42.5(pid=19690): stderr: | 20221208220849227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220849227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220849228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220849228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220849228 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220849229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220849229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:50.692017 run osmo-stp_10.42.42.5(pid=19690): stdout: | (launched: 2022-12-08_22:08:49.058399) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:50.818278 run osmo-stp_10.42.42.5(pid=19690): stderr: | 20221208220849227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220849227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220849228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220849228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220849228 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220849229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220849229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:50.967789 run patchelf(pid=19693): Terminating (SIGINT) 22:08:51.139644 run patchelf(pid=19693): Terminated: ok {rc=0} 22:08:51.264120 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19690): Process ended prematurely: osmo-stp_10.42.42.5(pid=19690) [trial-2350↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19690)] [trial-2350↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:08:51.273889 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 22:08:51.301667 run osmo-hlr_10.42.42.2(pid=19687): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19687)] 22:08:51.351028 run osmo-hlr_10.42.42.2(pid=19687): stdout: | (launched: 2022-12-08_22:08:48.102570) 22:08:51.401768 run osmo-hlr_10.42.42.2(pid=19687): stderr: | 20221208220848276 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220848276 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220848276 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220848277 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220848277 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220848277 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220848289 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220848298 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220848298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220848299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:08:51.453314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19680): Terminating (SIGTERM) 22:08:51.494388 run iperf3-srv_10.42.42.10(pid=19681): Terminating (SIGTERM) 22:08:51.535393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19682): Terminating (SIGTERM) 22:08:51.576334 run iperf3-srv_10.42.42.10(pid=19683): Terminating (SIGTERM) 22:08:51.616981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19686): Terminating (SIGTERM) 22:08:51.657931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19689): Terminating (SIGTERM) 22:08:51.698914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19692): Terminating (SIGTERM) 22:08:51.739907 --- ParallelTerminationStrategy: PID 19680 died... 22:08:51.759204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19680): Terminated: ok {rc=0} 22:08:51.804999 --- ParallelTerminationStrategy: PID 19681 died... 22:08:51.823857 run iperf3-srv_10.42.42.10(pid=19681): Terminated {rc=256} 22:08:51.869212 --- ParallelTerminationStrategy: PID 19682 died... 22:08:51.888400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19682): Terminated: ok {rc=0} 22:08:51.934159 --- ParallelTerminationStrategy: PID 19683 died... 22:08:51.953108 run iperf3-srv_10.42.42.10(pid=19683): Terminated {rc=256} 22:08:51.998510 --- ParallelTerminationStrategy: PID 19686 died... 22:08:52.017410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19686): Terminated: ok {rc=0} 22:08:52.062773 --- ParallelTerminationStrategy: PID 19689 died... 22:08:52.081782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19689): Terminated: ok {rc=0} 22:08:52.127155 --- ParallelTerminationStrategy: PID 19692 died... 22:08:52.146361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19692): Terminated: ok {rc=0} 22:08:52.234750 bus /gobi_0: Setting Powered False 22:08:53.333904 bus /gobi_0: Setting Powered False 22:08:54.447204 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:08:55.596407 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:55.608605 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:08:55.682284 tst iperf3.py: using LAC 17073 22:08:55.808893 tst iperf3.py: using RAC 243 22:08:55.935470 tst iperf3.py: using CellId 17073 22:08:56.064194 tst iperf3.py: using BVCI 17074 22:08:56.183870 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:56.195134 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:56.206208 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:56.217381 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:56.228332 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:56.239421 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:56.250663 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:56.261735 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:56.272791 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:08:56.386830 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:08:56.590205 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:08:56.894551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19694): Launched 22:08:57.158023 run iperf3-srv_10.42.42.10(pid=19695): Launched 22:08:57.271636 tst iperf3.py:8: start network... 22:08:57.474439 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:08:57.942348 run create_hlr_db(pid=19696): Launched 22:08:58.058120 bus /gobi_6: Setting Powered False 22:08:59.118422 run create_hlr_db(pid=19696): Terminated: ok {rc=0} 22:08:59.560331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19698): Launched 22:08:59.883637 run osmo-hlr_10.42.42.2(pid=19699): Launched 22:09:00.006949 run osmo-stp_10.42.42.5: Starting osmo-stp 22:09:00.564177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19701): Launched 22:09:00.904553 run osmo-stp_10.42.42.5(pid=19702): Launched 22:09:01.101819 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:09:01.887241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19704): Launched 22:09:02.015765 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:09:02.293910 run patchelf(pid=19705): Launched 22:09:02.472581 run osmo-stp_10.42.42.5(pid=19702): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19702)] 22:09:02.602268 run osmo-stp_10.42.42.5(pid=19702): stdout: | (launched: 2022-12-08_22:09:00.828436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:02.733503 run osmo-stp_10.42.42.5(pid=19702): stderr: | 20221208220901180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220901181 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220901181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220901187 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220901187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220901187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220901187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:02.864327 run osmo-stp_10.42.42.5(pid=19702): stdout: | (launched: 2022-12-08_22:09:00.828436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:02.990356 run osmo-stp_10.42.42.5(pid=19702): stderr: | 20221208220901180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220901181 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220901181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220901187 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220901187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220901187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220901187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:03.139059 run patchelf(pid=19705): Terminating (SIGINT) 22:09:03.310465 run patchelf(pid=19705): Terminated: ok {rc=0} 22:09:03.433690 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19702): Process ended prematurely: osmo-stp_10.42.42.5(pid=19702) [trial-2350↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19702)] [trial-2350↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 22:09:03.443183 tst iperf3.py:8: Test FAILED (7.9 sec) 22:09:03.471511 run osmo-hlr_10.42.42.2(pid=19699): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19699)] 22:09:03.521045 run osmo-hlr_10.42.42.2(pid=19699): stdout: | (launched: 2022-12-08_22:08:59.825498) 22:09:03.572102 run osmo-hlr_10.42.42.2(pid=19699): stderr: | 20221208220900023 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220900023 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220900023 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220900023 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220900023 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220900023 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220900035 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220900043 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220900044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220900044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:09:03.623668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19694): Terminating (SIGTERM) 22:09:03.664870 run iperf3-srv_10.42.42.10(pid=19695): Terminating (SIGTERM) 22:09:03.706492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19698): Terminating (SIGTERM) 22:09:03.747509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19701): Terminating (SIGTERM) 22:09:03.789161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19704): Terminating (SIGTERM) 22:09:03.830675 --- ParallelTerminationStrategy: PID 19694 died... 22:09:03.850098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19694): Terminated: ok {rc=0} 22:09:03.895731 --- ParallelTerminationStrategy: PID 19695 died... 22:09:03.914648 run iperf3-srv_10.42.42.10(pid=19695): Terminated {rc=256} 22:09:03.959935 --- ParallelTerminationStrategy: PID 19698 died... 22:09:03.978947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19698): Terminated: ok {rc=0} 22:09:04.024702 --- ParallelTerminationStrategy: PID 19701 died... 22:09:04.043778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19701): Terminated: ok {rc=0} 22:09:04.089220 --- ParallelTerminationStrategy: PID 19704 died... 22:09:04.108353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19704): Terminated: ok {rc=0} 22:09:04.195389 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:09:05.344424 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:05.355885 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:09:05.428114 tst iperf3m4.py: using LAC 17074 22:09:05.557840 tst iperf3m4.py: using RAC 244 22:09:05.686895 tst iperf3m4.py: using CellId 17074 22:09:05.814687 tst iperf3m4.py: using BVCI 17075 22:09:05.934037 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:05.945525 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:05.956825 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:05.968320 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:05.979765 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:05.991127 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:06.002588 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:06.013955 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:06.025451 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:09:06.141281 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:09:06.258768 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:09:06.378774 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:09:06.499452 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:09:06.718693 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:09:07.043722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19706): Launched 22:09:07.325568 run iperf3-srv_10.42.42.10(pid=19707): Launched 22:09:07.447659 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:09:07.668159 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:09:07.994347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19708): Launched 22:09:08.275280 run iperf3-srv_10.42.42.10(pid=19709): Launched 22:09:08.397383 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:09:08.615852 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:09:08.941776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19710): Launched 22:09:09.222150 run iperf3-srv_10.42.42.10(pid=19711): Launched 22:09:09.343373 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:09:09.561310 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:09:09.886176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19712): Launched 22:09:10.167205 run iperf3-srv_10.42.42.10(pid=19713): Launched 22:09:10.289153 tst iperf3m4.py:8: start network... 22:09:10.507724 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:09:11.010314 run create_hlr_db(pid=19714): Launched 22:09:11.141709 bus /gobi_6: Setting Powered False 22:09:12.206149 run create_hlr_db(pid=19714): Terminated: ok {rc=0} 22:09:12.657919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19716): Launched 22:09:12.982712 run osmo-hlr_10.42.42.2(pid=19717): Launched 22:09:13.106145 run osmo-stp_10.42.42.5: Starting osmo-stp 22:09:13.663147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19719): Launched 22:09:13.986986 run osmo-stp_10.42.42.5(pid=19720): Launched 22:09:14.111400 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:09:14.674310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19722): Launched 22:09:14.798483 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:09:15.072466 run patchelf(pid=19723): Launched 22:09:15.252494 run osmo-stp_10.42.42.5(pid=19720): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19720)] 22:09:15.390299 run osmo-stp_10.42.42.5(pid=19720): stdout: | (launched: 2022-12-08_22:09:13.928456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:15.529233 run osmo-stp_10.42.42.5(pid=19720): stderr: | 20221208220914120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220914120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220914120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220914120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220914121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220914121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220914121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:15.668286 run osmo-stp_10.42.42.5(pid=19720): stdout: | (launched: 2022-12-08_22:09:13.928456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:15.802087 run osmo-stp_10.42.42.5(pid=19720): stderr: | 20221208220914120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220914120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220914120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220914120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220914121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220914121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220914121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:15.996356 run patchelf(pid=19723): Terminating (SIGINT) 22:09:16.184472 run patchelf(pid=19723): Terminated: ok {rc=0} 22:09:16.318768 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19720): Process ended prematurely: osmo-stp_10.42.42.5(pid=19720) [trial-2350↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19720)] [trial-2350↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:09:16.330170 tst iperf3m4.py:8: Test FAILED (11.0 sec) 22:09:16.361861 run osmo-hlr_10.42.42.2(pid=19717): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19717)] 22:09:16.414188 run osmo-hlr_10.42.42.2(pid=19717): stdout: | (launched: 2022-12-08_22:09:12.924076) 22:09:16.468202 run osmo-hlr_10.42.42.2(pid=19717): stderr: | 20221208220913125 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220913125 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220913126 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220913126 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220913126 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220913126 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220913138 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220913148 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220913149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220913149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:09:16.522624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19706): Terminating (SIGTERM) 22:09:16.566404 run iperf3-srv_10.42.42.10(pid=19707): Terminating (SIGTERM) 22:09:16.611615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19708): Terminating (SIGTERM) 22:09:16.655743 run iperf3-srv_10.42.42.10(pid=19709): Terminating (SIGTERM) 22:09:16.701498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19710): Terminating (SIGTERM) 22:09:16.746266 run iperf3-srv_10.42.42.10(pid=19711): Terminating (SIGTERM) 22:09:16.791482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19712): Terminating (SIGTERM) 22:09:16.835216 run iperf3-srv_10.42.42.10(pid=19713): Terminating (SIGTERM) 22:09:16.878623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19716): Terminating (SIGTERM) 22:09:16.922586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19719): Terminating (SIGTERM) 22:09:16.966568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19722): Terminating (SIGTERM) 22:09:17.010410 --- ParallelTerminationStrategy: PID 19706 died... 22:09:17.030942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19706): Terminated: ok {rc=0} 22:09:17.079231 --- ParallelTerminationStrategy: PID 19707 died... 22:09:17.099791 run iperf3-srv_10.42.42.10(pid=19707): Terminated {rc=256} 22:09:17.148873 --- ParallelTerminationStrategy: PID 19708 died... 22:09:17.169523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19708): Terminated: ok {rc=0} 22:09:17.217766 --- ParallelTerminationStrategy: PID 19709 died... 22:09:17.238234 run iperf3-srv_10.42.42.10(pid=19709): Terminated {rc=256} 22:09:17.286214 --- ParallelTerminationStrategy: PID 19710 died... 22:09:17.306586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19710): Terminated: ok {rc=0} 22:09:17.355057 --- ParallelTerminationStrategy: PID 19711 died... 22:09:17.374970 run iperf3-srv_10.42.42.10(pid=19711): Terminated {rc=256} 22:09:17.421752 --- ParallelTerminationStrategy: PID 19712 died... 22:09:17.441579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19712): Terminated: ok {rc=0} 22:09:17.488857 --- ParallelTerminationStrategy: PID 19713 died... 22:09:17.508820 run iperf3-srv_10.42.42.10(pid=19713): Terminated {rc=256} 22:09:17.555763 --- ParallelTerminationStrategy: PID 19716 died... 22:09:17.575725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19716): Terminated: ok {rc=0} 22:09:17.622886 --- ParallelTerminationStrategy: PID 19719 died... 22:09:17.642784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19719): Terminated: ok {rc=0} 22:09:17.690101 --- ParallelTerminationStrategy: PID 19722 died... 22:09:17.710058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19722): Terminated: ok {rc=0} 22:09:17.799547 bus /gobi_4: Setting Powered False 22:09:18.898448 bus /gobi_4: Setting Powered False 22:09:20.021497 bus /gobi_1: Setting Powered False 22:09:21.121859 bus /gobi_1: Setting Powered False 22:09:22.239883 bus /gobi_0: Setting Powered False 22:09:23.340691 bus /gobi_0: Setting Powered False 22:09:24.459491 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:09:25.563664 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:25.575131 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:09:25.645266 tst ping.py: using LAC 17075 22:09:25.762611 tst ping.py: using RAC 245 22:09:25.882891 tst ping.py: using CellId 17075 22:09:25.999925 tst ping.py: using BVCI 17076 22:09:26.109742 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:26.120501 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:26.131118 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:26.142134 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:26.152821 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:26.163671 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:26.174687 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:26.185529 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:09:26.298781 tst ping.py:19: start network... 22:09:26.497985 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:09:26.958671 run create_hlr_db(pid=19724): Launched 22:09:27.071690 bus /gobi_6: Setting Powered False 22:09:28.131101 run create_hlr_db(pid=19724): Terminated: ok {rc=0} 22:09:28.567061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19726): Launched 22:09:28.885504 run osmo-hlr_10.42.42.2(pid=19727): Launched 22:09:29.006779 run osmo-stp_10.42.42.5: Starting osmo-stp 22:09:29.558064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19729): Launched 22:09:29.874418 run osmo-stp_10.42.42.5(pid=19730): Launched 22:09:29.995053 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:09:30.543761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19732): Launched 22:09:30.665377 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:09:30.963193 run patchelf(pid=19733): Launched 22:09:31.141210 run osmo-stp_10.42.42.5(pid=19730): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19730)] 22:09:31.272875 run osmo-stp_10.42.42.5(pid=19730): stdout: | (launched: 2022-12-08_22:09:29.817046) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:31.407403 run osmo-stp_10.42.42.5(pid=19730): stderr: | 20221208220930008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220930008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220930008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220930009 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220930009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220930009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220930009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:31.541727 run osmo-stp_10.42.42.5(pid=19730): stdout: | (launched: 2022-12-08_22:09:29.817046) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:31.669838 run osmo-stp_10.42.42.5(pid=19730): stderr: | 20221208220930008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220930008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220930008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220930009 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220930009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220930009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220930009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:31.820692 run patchelf(pid=19733): Terminating (SIGINT) 22:09:31.995359 run patchelf(pid=19733): Terminated: ok {rc=0} 22:09:32.120496 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19730): Process ended prematurely: osmo-stp_10.42.42.5(pid=19730) [trial-2350↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19730)] [trial-2350↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 22:09:32.131295 tst ping.py:22: Test FAILED (6.6 sec) 22:09:32.162904 run osmo-hlr_10.42.42.2(pid=19727): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19727)] 22:09:32.214374 run osmo-hlr_10.42.42.2(pid=19727): stdout: | (launched: 2022-12-08_22:09:28.828234) 22:09:32.266513 run osmo-hlr_10.42.42.2(pid=19727): stderr: | 20221208220929026 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220929026 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220929026 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220929026 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220929026 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220929026 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220929038 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220929046 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220929046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220929046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:09:32.319335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19726): Terminating (SIGTERM) 22:09:32.361192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19729): Terminating (SIGTERM) 22:09:32.402886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19732): Terminating (SIGTERM) 22:09:32.444739 --- ParallelTerminationStrategy: PID 19726 died... 22:09:32.464522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19726): Terminated: ok {rc=0} 22:09:32.511574 --- ParallelTerminationStrategy: PID 19729 died... 22:09:32.530736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19729): Terminated: ok {rc=0} 22:09:32.577888 --- ParallelTerminationStrategy: PID 19732 died... 22:09:32.597013 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19732): Terminated: ok {rc=0} 22:09:32.687067 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:09:33.779471 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:33.791363 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:09:33.864724 tst ping_idle_ping.py: using LAC 17076 22:09:33.991952 tst ping_idle_ping.py: using RAC 246 22:09:34.116909 tst ping_idle_ping.py: using CellId 17076 22:09:34.243032 tst ping_idle_ping.py: using BVCI 17077 22:09:34.361124 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:34.372644 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:34.383739 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:34.395086 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:34.406314 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:34.417658 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:34.428896 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:34.440243 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:09:34.558876 tst ping_idle_ping.py:24: start network... 22:09:34.775070 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:09:35.276189 run create_hlr_db(pid=19735): Launched 22:09:35.405221 bus /gobi_6: Setting Powered False 22:09:36.468612 run create_hlr_db(pid=19735): Terminated: ok {rc=0} 22:09:36.897063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19742): Launched 22:09:37.194423 run osmo-hlr_10.42.42.2(pid=19743): Launched 22:09:37.308680 run osmo-stp_10.42.42.5: Starting osmo-stp 22:09:37.837354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19745): Launched 22:09:38.134772 run osmo-stp_10.42.42.5(pid=19746): Launched 22:09:38.247402 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:09:38.760175 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19748): Launched 22:09:38.874145 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:09:39.125913 run patchelf(pid=19749): Launched 22:09:39.305234 run osmo-stp_10.42.42.5(pid=19746): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19746)] 22:09:39.442572 run osmo-stp_10.42.42.5(pid=19746): stdout: | (launched: 2022-12-08_22:09:38.080912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:39.580907 run osmo-stp_10.42.42.5(pid=19746): stderr: | 20221208220938248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220938248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220938248 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220938249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220938249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220938250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220938250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:39.721054 run osmo-stp_10.42.42.5(pid=19746): stdout: | (launched: 2022-12-08_22:09:38.080912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:39.853801 run osmo-stp_10.42.42.5(pid=19746): stderr: | 20221208220938248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220938248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220938248 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220938249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220938249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220938250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220938250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:40.010686 run patchelf(pid=19749): Terminating (SIGINT) 22:09:40.191604 run patchelf(pid=19749): Terminated: ok {rc=0} 22:09:40.322034 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19746): Process ended prematurely: osmo-stp_10.42.42.5(pid=19746) [trial-2350↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19746)] [trial-2350↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:09:40.331695 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 22:09:40.360050 run osmo-hlr_10.42.42.2(pid=19743): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19743)] 22:09:40.410824 run osmo-hlr_10.42.42.2(pid=19743): stdout: | (launched: 2022-12-08_22:09:37.140491) 22:09:40.463506 run osmo-hlr_10.42.42.2(pid=19743): stderr: | 20221208220937313 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220937313 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220937313 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220937313 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220937313 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220937313 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220937326 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220937335 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220937335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220937335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:09:40.516365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19742): Terminating (SIGTERM) 22:09:40.559545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19745): Terminating (SIGTERM) 22:09:40.602054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19748): Terminating (SIGTERM) 22:09:40.644816 --- ParallelTerminationStrategy: PID 19742 died... 22:09:40.664893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19742): Terminated: ok {rc=0} 22:09:40.712427 --- ParallelTerminationStrategy: PID 19745 died... 22:09:40.732455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19745): Terminated: ok {rc=0} 22:09:40.779448 --- ParallelTerminationStrategy: PID 19748 died... 22:09:40.799200 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19748): Terminated: ok {rc=0} 22:09:40.887713 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:09:42.192280 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:09:42.198279 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:09:42.231573 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 22:09:42.269656 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 22:09:42.355014 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:09:42.388532 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 22:09:42.427829 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 22:09:43.021842 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 22:09:43.074172 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:43.084933 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:09:43.153418 tst cs_paging_gprs_active.py: using LAC 17077 22:09:43.280217 tst cs_paging_gprs_active.py: using RAC 247 22:09:43.400173 tst cs_paging_gprs_active.py: using CellId 17077 22:09:43.521565 tst cs_paging_gprs_active.py: using BVCI 17078 22:09:43.633969 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:43.644593 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:43.655206 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:43.666076 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:43.676623 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:43.687413 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:43.698532 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:43.709265 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:43.720125 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:09:43.839107 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:09:43.959933 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:09:44.178625 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:09:44.503497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19754): Launched 22:09:44.787382 run iperf3-srv_10.42.42.10(pid=19755): Launched 22:09:44.909393 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:09:45.127444 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:09:45.451763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19756): Launched 22:09:45.733628 run iperf3-srv_10.42.42.10(pid=19757): Launched 22:09:45.870085 tst cs_paging_gprs_active.py:38: start network... 22:09:46.106957 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:09:46.622425 run create_hlr_db(pid=19758): Launched 22:09:46.789853 bus /gobi_6: Setting Powered False 22:09:47.850724 run create_hlr_db(pid=19758): Terminated: ok {rc=0} 22:09:48.302256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19760): Launched 22:09:48.625837 run osmo-hlr_10.42.42.2(pid=19761): Launched 22:09:48.749706 run osmo-stp_10.42.42.5: Starting osmo-stp 22:09:49.308150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19763): Launched 22:09:49.631582 run osmo-stp_10.42.42.5(pid=19764): Launched 22:09:49.755428 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:09:50.313713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19766): Launched 22:09:50.437652 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:09:50.711543 run patchelf(pid=19767): Launched 22:09:50.891641 run osmo-stp_10.42.42.5(pid=19764): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19764)] 22:09:51.029808 run osmo-stp_10.42.42.5(pid=19764): stdout: | (launched: 2022-12-08_22:09:49.573457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:51.169267 run osmo-stp_10.42.42.5(pid=19764): stderr: | 20221208220949770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220949771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220949771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220949771 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220949772 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220949772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220949772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:51.308554 run osmo-stp_10.42.42.5(pid=19764): stdout: | (launched: 2022-12-08_22:09:49.573457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:51.442515 run osmo-stp_10.42.42.5(pid=19764): stderr: | 20221208220949770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208220949771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208220949771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208220949771 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208220949772 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208220949772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208220949772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:51.601322 run patchelf(pid=19767): Terminating (SIGINT) 22:09:51.784092 run patchelf(pid=19767): Terminated: ok {rc=0} 22:09:51.915966 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19764): Process ended prematurely: osmo-stp_10.42.42.5(pid=19764) [trial-2350↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19764)] [trial-2350↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 22:09:51.926386 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 22:09:51.955145 run osmo-hlr_10.42.42.2(pid=19761): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19761)] 22:09:52.006309 run osmo-hlr_10.42.42.2(pid=19761): stdout: | (launched: 2022-12-08_22:09:48.567204) 22:09:52.059060 run osmo-hlr_10.42.42.2(pid=19761): stderr: | 20221208220948767 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208220948767 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208220948767 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208220948767 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208220948767 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208220948767 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208220948782 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208220948791 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208220948791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208220948792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:09:52.112216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19754): Terminating (SIGTERM) 22:09:52.154857 run iperf3-srv_10.42.42.10(pid=19755): Terminating (SIGTERM) 22:09:52.197236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19756): Terminating (SIGTERM) 22:09:52.239921 run iperf3-srv_10.42.42.10(pid=19757): Terminating (SIGTERM) 22:09:52.282470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19760): Terminating (SIGTERM) 22:09:52.324938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19763): Terminating (SIGTERM) 22:09:52.367774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19766): Terminating (SIGTERM) 22:09:52.410376 --- ParallelTerminationStrategy: PID 19754 died... 22:09:52.430543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19754): Terminated: ok {rc=0} 22:09:52.477532 --- ParallelTerminationStrategy: PID 19755 died... 22:09:52.497416 run iperf3-srv_10.42.42.10(pid=19755): Terminated {rc=256} 22:09:52.544061 --- ParallelTerminationStrategy: PID 19756 died... 22:09:52.564102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19756): Terminated: ok {rc=0} 22:09:52.610829 --- ParallelTerminationStrategy: PID 19757 died... 22:09:52.630854 run iperf3-srv_10.42.42.10(pid=19757): Terminated {rc=256} 22:09:52.678004 --- ParallelTerminationStrategy: PID 19760 died... 22:09:52.697797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19760): Terminated: ok {rc=0} 22:09:52.744674 --- ParallelTerminationStrategy: PID 19763 died... 22:09:52.764563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19763): Terminated: ok {rc=0} 22:09:52.811312 --- ParallelTerminationStrategy: PID 19766 died... 22:09:52.831169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19766): Terminated: ok {rc=0} 22:09:52.920306 bus /gobi_0: Setting Powered False 22:09:54.018678 bus /gobi_0: Setting Powered False 22:09:55.135660 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 22:09:56.283432 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:56.294839 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:09:56.365936 tst iperf3.py: using LAC 17078 22:09:56.485437 tst iperf3.py: using RAC 248 22:09:56.614394 tst iperf3.py: using CellId 17078 22:09:56.743607 tst iperf3.py: using BVCI 17079 22:09:56.863299 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:56.874771 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:56.885824 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:56.896820 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:56.907847 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:56.919020 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:56.930250 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:56.941230 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:56.952405 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:09:57.069130 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:09:57.286729 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:09:57.610675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19770): Launched 22:09:57.893013 run iperf3-srv_10.42.42.10(pid=19771): Launched 22:09:58.014391 tst iperf3.py:8: start network... 22:09:58.232309 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:09:58.733995 run create_hlr_db(pid=19772): Launched 22:09:58.865228 bus /gobi_6: Setting Powered False 22:09:59.929171 run create_hlr_db(pid=19772): Terminated: ok {rc=0} 22:10:00.378350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19776): Launched 22:10:00.701377 run osmo-hlr_10.42.42.2(pid=19777): Launched 22:10:00.824667 run osmo-stp_10.42.42.5: Starting osmo-stp 22:10:01.472300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19779): Launched 22:10:01.801799 run osmo-stp_10.42.42.5(pid=19780): Launched 22:10:02.143400 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:10:02.774789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19785): Launched 22:10:02.898775 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:10:03.173617 run patchelf(pid=19786): Launched 22:10:03.354347 run osmo-stp_10.42.42.5(pid=19780): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19780)] 22:10:03.492135 run osmo-stp_10.42.42.5(pid=19780): stdout: | (launched: 2022-12-08_22:10:01.736738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:03.631451 run osmo-stp_10.42.42.5(pid=19780): stderr: | 20221208221001950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221001950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221001951 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221001951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221001951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221001951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221001951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:03.772030 run osmo-stp_10.42.42.5(pid=19780): stdout: | (launched: 2022-12-08_22:10:01.736738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:03.906161 run osmo-stp_10.42.42.5(pid=19780): stderr: | 20221208221001950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221001950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221001951 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221001951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221001951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221001951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221001951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:04.065369 run patchelf(pid=19786): Terminating (SIGINT) 22:10:04.248472 run patchelf(pid=19786): Terminated: ok {rc=0} 22:10:04.380224 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19780): Process ended prematurely: osmo-stp_10.42.42.5(pid=19780) [trial-2350↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19780)] [trial-2350↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 22:10:04.390643 tst iperf3.py:8: Test FAILED (8.1 sec) 22:10:04.419496 run osmo-hlr_10.42.42.2(pid=19777): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19777)] 22:10:04.470608 run osmo-hlr_10.42.42.2(pid=19777): stdout: | (launched: 2022-12-08_22:10:00.642213) 22:10:04.523829 run osmo-hlr_10.42.42.2(pid=19777): stderr: | 20221208221000886 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221000886 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221000886 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221000886 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221000886 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221000886 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221000899 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221000935 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221000935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221000935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:10:04.577286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19770): Terminating (SIGTERM) 22:10:04.620151 run iperf3-srv_10.42.42.10(pid=19771): Terminating (SIGTERM) 22:10:04.663326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19776): Terminating (SIGTERM) 22:10:04.706824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19779): Terminating (SIGTERM) 22:10:04.750747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19785): Terminating (SIGTERM) 22:10:04.794026 --- ParallelTerminationStrategy: PID 19770 died... 22:10:04.814514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19770): Terminated: ok {rc=0} 22:10:04.862020 --- ParallelTerminationStrategy: PID 19771 died... 22:10:04.882038 run iperf3-srv_10.42.42.10(pid=19771): Terminated {rc=256} 22:10:04.929284 --- ParallelTerminationStrategy: PID 19776 died... 22:10:04.949233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19776): Terminated: ok {rc=0} 22:10:04.996717 --- ParallelTerminationStrategy: PID 19779 died... 22:10:05.016862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19779): Terminated: ok {rc=0} 22:10:05.064132 --- ParallelTerminationStrategy: PID 19785 died... 22:10:05.084126 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19785): Terminated: ok {rc=0} 22:10:05.173920 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 22:10:06.326725 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:06.338722 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:10:06.410864 tst iperf3m4.py: using LAC 17079 22:10:06.539585 tst iperf3m4.py: using RAC 249 22:10:06.666423 tst iperf3m4.py: using CellId 17079 22:10:06.795183 tst iperf3m4.py: using BVCI 17080 22:10:06.913134 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:06.924442 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:06.935532 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:06.946722 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:06.957724 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:06.968778 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:06.979995 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:06.991101 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:07.002488 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:10:07.121090 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:10:07.239377 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:10:07.354785 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:10:07.473099 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:10:07.692922 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:10:08.017965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19787): Launched 22:10:08.299111 run iperf3-srv_10.42.42.10(pid=19788): Launched 22:10:08.421187 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:10:08.639821 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:10:08.966101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19789): Launched 22:10:09.246083 run iperf3-srv_10.42.42.10(pid=19790): Launched 22:10:09.367277 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:10:09.585110 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:10:09.910368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19791): Launched 22:10:10.189999 run iperf3-srv_10.42.42.10(pid=19792): Launched 22:10:10.310992 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:10:10.529780 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:10:10.855425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19793): Launched 22:10:11.135155 run iperf3-srv_10.42.42.10(pid=19794): Launched 22:10:11.256247 tst iperf3m4.py:8: start network... 22:10:11.474038 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:10:11.976751 run create_hlr_db(pid=19795): Launched 22:10:12.108159 bus /gobi_6: Setting Powered False 22:10:13.171825 run create_hlr_db(pid=19795): Terminated: ok {rc=0} 22:10:13.621933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19797): Launched 22:10:13.944538 run osmo-hlr_10.42.42.2(pid=19798): Launched 22:10:14.066817 run osmo-stp_10.42.42.5: Starting osmo-stp 22:10:14.624094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19800): Launched 22:10:14.946324 run osmo-stp_10.42.42.5(pid=19801): Launched 22:10:15.068398 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:10:15.625585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19803): Launched 22:10:15.749890 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:10:16.037172 run patchelf(pid=19804): Launched 22:10:16.231270 run osmo-stp_10.42.42.5(pid=19801): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19801)] 22:10:16.371564 run osmo-stp_10.42.42.5(pid=19801): stdout: | (launched: 2022-12-08_22:10:14.888298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:16.512336 run osmo-stp_10.42.42.5(pid=19801): stderr: | 20221208221015079 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221015079 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221015079 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221015080 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221015080 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221015080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221015080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:16.653436 run osmo-stp_10.42.42.5(pid=19801): stdout: | (launched: 2022-12-08_22:10:14.888298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:16.789576 run osmo-stp_10.42.42.5(pid=19801): stderr: | 20221208221015079 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221015079 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221015079 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221015080 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221015080 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221015080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221015080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:16.950650 run patchelf(pid=19804): Terminating (SIGINT) 22:10:17.135398 run patchelf(pid=19804): Terminated: ok {rc=0} 22:10:17.267279 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19801): Process ended prematurely: osmo-stp_10.42.42.5(pid=19801) [trial-2350↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19801)] [trial-2350↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 22:10:17.277548 tst iperf3m4.py:8: Test FAILED (11.0 sec) 22:10:17.306472 run osmo-hlr_10.42.42.2(pid=19798): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19798)] 22:10:17.357655 run osmo-hlr_10.42.42.2(pid=19798): stdout: | (launched: 2022-12-08_22:10:13.886362) 22:10:17.410063 run osmo-hlr_10.42.42.2(pid=19798): stderr: | 20221208221014083 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221014083 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221014083 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221014083 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221014083 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221014083 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221014095 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221014103 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221014103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221014103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:10:17.462864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19787): Terminating (SIGTERM) 22:10:17.505308 run iperf3-srv_10.42.42.10(pid=19788): Terminating (SIGTERM) 22:10:17.547815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19789): Terminating (SIGTERM) 22:10:17.590383 run iperf3-srv_10.42.42.10(pid=19790): Terminating (SIGTERM) 22:10:17.632679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19791): Terminating (SIGTERM) 22:10:17.675672 run iperf3-srv_10.42.42.10(pid=19792): Terminating (SIGTERM) 22:10:17.718440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19793): Terminating (SIGTERM) 22:10:17.761091 run iperf3-srv_10.42.42.10(pid=19794): Terminating (SIGTERM) 22:10:17.803427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19797): Terminating (SIGTERM) 22:10:17.845956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19800): Terminating (SIGTERM) 22:10:17.888423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19803): Terminating (SIGTERM) 22:10:17.931100 --- ParallelTerminationStrategy: PID 19787 died... 22:10:17.951518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19787): Terminated: ok {rc=0} 22:10:17.998807 --- ParallelTerminationStrategy: PID 19788 died... 22:10:18.018675 run iperf3-srv_10.42.42.10(pid=19788): Terminated {rc=256} 22:10:18.065468 --- ParallelTerminationStrategy: PID 19789 died... 22:10:18.085343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19789): Terminated: ok {rc=0} 22:10:18.131933 --- ParallelTerminationStrategy: PID 19790 died... 22:10:18.151524 run iperf3-srv_10.42.42.10(pid=19790): Terminated {rc=256} 22:10:18.198010 --- ParallelTerminationStrategy: PID 19791 died... 22:10:18.218034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19791): Terminated: ok {rc=0} 22:10:18.264937 --- ParallelTerminationStrategy: PID 19792 died... 22:10:18.284562 run iperf3-srv_10.42.42.10(pid=19792): Terminated {rc=256} 22:10:18.331085 --- ParallelTerminationStrategy: PID 19793 died... 22:10:18.350862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19793): Terminated: ok {rc=0} 22:10:18.397665 --- ParallelTerminationStrategy: PID 19794 died... 22:10:18.417464 run iperf3-srv_10.42.42.10(pid=19794): Terminated {rc=256} 22:10:18.463965 --- ParallelTerminationStrategy: PID 19797 died... 22:10:18.483723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19797): Terminated: ok {rc=0} 22:10:18.530430 --- ParallelTerminationStrategy: PID 19800 died... 22:10:18.550273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19800): Terminated: ok {rc=0} 22:10:18.597085 --- ParallelTerminationStrategy: PID 19803 died... 22:10:18.616861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19803): Terminated: ok {rc=0} 22:10:18.704657 bus /gobi_4: Setting Powered False 22:10:19.806040 bus /gobi_4: Setting Powered False 22:10:20.923135 bus /gobi_1: Setting Powered False 22:10:22.021701 bus /gobi_1: Setting Powered False 22:10:23.135429 bus /gobi_0: Setting Powered False 22:10:24.233362 bus /gobi_0: Setting Powered False 22:10:25.351142 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 22:10:26.455008 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:26.466510 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:10:26.541783 tst ping.py: using LAC 17080 22:10:26.667482 tst ping.py: using RAC 250 22:10:26.786380 tst ping.py: using CellId 17080 22:10:26.904147 tst ping.py: using BVCI 17081 22:10:27.013288 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:27.024178 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:27.034936 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:27.045965 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:27.056679 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:27.067562 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:27.078518 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:27.089322 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:10:27.202524 tst ping.py:19: start network... 22:10:27.400642 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:10:27.860163 run create_hlr_db(pid=19805): Launched 22:10:27.972694 bus /gobi_6: Setting Powered False 22:10:29.032935 run create_hlr_db(pid=19805): Terminated: ok {rc=0} 22:10:29.450976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19807): Launched 22:10:29.748567 run osmo-hlr_10.42.42.2(pid=19808): Launched 22:10:29.862226 run osmo-stp_10.42.42.5: Starting osmo-stp 22:10:30.398214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19810): Launched 22:10:30.694884 run osmo-stp_10.42.42.5(pid=19811): Launched 22:10:30.808031 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:10:31.436144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19813): Launched 22:10:31.568888 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:10:31.854737 run patchelf(pid=19814): Launched 22:10:32.044164 run osmo-stp_10.42.42.5(pid=19811): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19811)] 22:10:32.182790 run osmo-stp_10.42.42.5(pid=19811): stdout: | (launched: 2022-12-08_22:10:30.640839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:32.321708 run osmo-stp_10.42.42.5(pid=19811): stderr: | 20221208221030811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221030811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221030811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221030812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221030812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221030812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221030812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:32.458411 run osmo-stp_10.42.42.5(pid=19811): stdout: | (launched: 2022-12-08_22:10:30.640839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:32.589185 run osmo-stp_10.42.42.5(pid=19811): stderr: | 20221208221030811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221030811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221030811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221030812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221030812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221030812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221030812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:32.744111 run patchelf(pid=19814): Terminating (SIGINT) 22:10:32.922953 run patchelf(pid=19814): Terminated: ok {rc=0} 22:10:33.052226 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19811): Process ended prematurely: osmo-stp_10.42.42.5(pid=19811) [trial-2350↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19811)] [trial-2350↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 22:10:33.062184 tst ping.py:22: Test FAILED (6.6 sec) 22:10:33.090657 run osmo-hlr_10.42.42.2(pid=19808): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19808)] 22:10:33.141841 run osmo-hlr_10.42.42.2(pid=19808): stdout: | (launched: 2022-12-08_22:10:29.694253) 22:10:33.194414 run osmo-hlr_10.42.42.2(pid=19808): stderr: | 20221208221029868 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221029868 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221029868 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221029868 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221029868 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221029868 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221029881 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221029889 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221029889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221029889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:10:33.247423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19807): Terminating (SIGTERM) 22:10:33.290256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19810): Terminating (SIGTERM) 22:10:33.333143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19813): Terminating (SIGTERM) 22:10:33.376073 --- ParallelTerminationStrategy: PID 19807 died... 22:10:33.396510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19807): Terminated: ok {rc=0} 22:10:33.443941 --- ParallelTerminationStrategy: PID 19810 died... 22:10:33.463880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19810): Terminated: ok {rc=0} 22:10:33.510955 --- ParallelTerminationStrategy: PID 19813 died... 22:10:33.530879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19813): Terminated: ok {rc=0} 22:10:33.619366 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 22:10:34.708354 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:34.720722 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:10:34.807456 tst ping_idle_ping.py: using LAC 17081 22:10:34.929672 tst ping_idle_ping.py: using RAC 251 22:10:35.060270 tst ping_idle_ping.py: using CellId 17081 22:10:35.185439 tst ping_idle_ping.py: using BVCI 17082 22:10:35.300847 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:35.312320 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:35.323591 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:35.335259 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:35.346547 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:35.357862 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:35.369180 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:35.380173 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:10:35.493471 tst ping_idle_ping.py:24: start network... 22:10:35.693651 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:10:36.157696 run create_hlr_db(pid=19815): Launched 22:10:36.273268 bus /gobi_6: Setting Powered False 22:10:37.333086 run create_hlr_db(pid=19815): Terminated: ok {rc=0} 22:10:37.771046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19817): Launched 22:10:38.088089 run osmo-hlr_10.42.42.2(pid=19818): Launched 22:10:38.209234 run osmo-stp_10.42.42.5: Starting osmo-stp 22:10:38.757641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19820): Launched 22:10:39.075831 run osmo-stp_10.42.42.5(pid=19821): Launched 22:10:39.197533 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:10:39.747587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19823): Launched 22:10:39.869923 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:10:40.138560 run patchelf(pid=19824): Launched 22:10:40.315985 run osmo-stp_10.42.42.5(pid=19821): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19821)] 22:10:40.452276 run osmo-stp_10.42.42.5(pid=19821): stdout: | (launched: 2022-12-08_22:10:39.018362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:40.589632 run osmo-stp_10.42.42.5(pid=19821): stderr: | 20221208221039212 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221039212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221039212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221039213 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221039213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221039213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221039213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:40.727545 run osmo-stp_10.42.42.5(pid=19821): stdout: | (launched: 2022-12-08_22:10:39.018362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:40.859130 run osmo-stp_10.42.42.5(pid=19821): stderr: | 20221208221039212 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221039212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221039212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221039213 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221039213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221039213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221039213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:41.014879 run patchelf(pid=19824): Terminating (SIGINT) 22:10:41.195455 run patchelf(pid=19824): Terminated: ok {rc=0} 22:10:41.324364 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19821): Process ended prematurely: osmo-stp_10.42.42.5(pid=19821) [trial-2350↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19821)] [trial-2350↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 22:10:41.334025 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:10:41.362191 run osmo-hlr_10.42.42.2(pid=19818): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19818)] 22:10:41.413092 run osmo-hlr_10.42.42.2(pid=19818): stdout: | (launched: 2022-12-08_22:10:38.030970) 22:10:41.465351 run osmo-hlr_10.42.42.2(pid=19818): stderr: | 20221208221038231 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221038231 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221038231 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221038231 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221038231 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221038231 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221038244 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221038254 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221038254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221038254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:10:41.518033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19817): Terminating (SIGTERM) 22:10:41.560328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19820): Terminating (SIGTERM) 22:10:41.602787 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19823): Terminating (SIGTERM) 22:10:41.645404 --- ParallelTerminationStrategy: PID 19817 died... 22:10:41.665539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19817): Terminated: ok {rc=0} 22:10:41.712881 --- ParallelTerminationStrategy: PID 19820 died... 22:10:41.732716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19820): Terminated: ok {rc=0} 22:10:41.779958 --- ParallelTerminationStrategy: PID 19823 died... 22:10:41.799745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19823): Terminated: ok {rc=0} 22:10:41.907139 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 22:10:43.226415 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:10:43.233687 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 22:10:43.268061 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 22:10:43.307547 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 22:10:43.396936 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 22:10:43.431500 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 22:10:43.470668 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 22:10:44.069345 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 22:10:44.121799 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:44.133677 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:10:44.187631 tst cs_paging_gprs_active.py: using LAC 17082 22:10:44.317491 tst cs_paging_gprs_active.py: using RAC 252 22:10:44.445236 tst cs_paging_gprs_active.py: using CellId 17082 22:10:44.573042 tst cs_paging_gprs_active.py: using BVCI 17083 22:10:44.691284 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:44.703329 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:44.714833 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:44.726525 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:44.738156 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:44.749832 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:44.761737 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:44.773422 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:44.785395 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:10:44.902460 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:10:45.017308 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:10:45.222221 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:10:45.527941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19828): Launched 22:10:45.793528 run iperf3-srv_10.42.42.10(pid=19829): Launched 22:10:45.911575 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:10:46.120445 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:10:46.447206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19830): Launched 22:10:46.722440 run iperf3-srv_10.42.42.10(pid=19831): Launched 22:10:46.853365 tst cs_paging_gprs_active.py:38: start network... 22:10:47.061803 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:10:47.536292 run create_hlr_db(pid=19832): Launched 22:10:47.654120 bus /gobi_6: Setting Powered False 22:10:48.714153 run create_hlr_db(pid=19832): Terminated: ok {rc=0} 22:10:49.137694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19834): Launched 22:10:49.441133 run osmo-hlr_10.42.42.2(pid=19835): Launched 22:10:49.557403 run osmo-stp_10.42.42.5: Starting osmo-stp 22:10:50.098631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19837): Launched 22:10:50.400651 run osmo-stp_10.42.42.5(pid=19838): Launched 22:10:50.516258 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:10:51.039605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19840): Launched 22:10:51.155831 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:10:51.412883 run patchelf(pid=19841): Launched 22:10:51.582362 run osmo-stp_10.42.42.5(pid=19838): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19838)] 22:10:51.711668 run osmo-stp_10.42.42.5(pid=19838): stdout: | (launched: 2022-12-08_22:10:50.345930) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:51.842822 run osmo-stp_10.42.42.5(pid=19838): stderr: | 20221208221050514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221050514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221050515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221050515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221050515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221050515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221050516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:51.974083 run osmo-stp_10.42.42.5(pid=19838): stdout: | (launched: 2022-12-08_22:10:50.345930) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:52.099802 run osmo-stp_10.42.42.5(pid=19838): stderr: | 20221208221050514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221050514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221050515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221050515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221050515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221050515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221050516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:52.248865 run patchelf(pid=19841): Terminating (SIGINT) 22:10:52.419891 run patchelf(pid=19841): Terminated: ok {rc=0} 22:10:52.543497 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19838): Process ended prematurely: osmo-stp_10.42.42.5(pid=19838) [trial-2350↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19838)] [trial-2350↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 22:10:52.553098 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 22:10:52.581367 run osmo-hlr_10.42.42.2(pid=19835): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19835)] 22:10:52.630385 run osmo-hlr_10.42.42.2(pid=19835): stdout: | (launched: 2022-12-08_22:10:49.386225) 22:10:52.681280 run osmo-hlr_10.42.42.2(pid=19835): stderr: | 20221208221049562 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221049562 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221049562 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221049562 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221049562 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221049562 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221049574 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221049582 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221049583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221049583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:10:52.732492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19828): Terminating (SIGTERM) 22:10:52.773430 run iperf3-srv_10.42.42.10(pid=19829): Terminating (SIGTERM) 22:10:52.814147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19830): Terminating (SIGTERM) 22:10:52.854951 run iperf3-srv_10.42.42.10(pid=19831): Terminating (SIGTERM) 22:10:52.895737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19834): Terminating (SIGTERM) 22:10:52.936392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19837): Terminating (SIGTERM) 22:10:52.976710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19840): Terminating (SIGTERM) 22:10:53.017417 --- ParallelTerminationStrategy: PID 19828 died... 22:10:53.036513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19828): Terminated: ok {rc=0} 22:10:53.081836 --- ParallelTerminationStrategy: PID 19829 died... 22:10:53.100631 run iperf3-srv_10.42.42.10(pid=19829): Terminated {rc=256} 22:10:53.145802 --- ParallelTerminationStrategy: PID 19830 died... 22:10:53.164500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19830): Terminated: ok {rc=0} 22:10:53.209499 --- ParallelTerminationStrategy: PID 19831 died... 22:10:53.228294 run iperf3-srv_10.42.42.10(pid=19831): Terminated {rc=256} 22:10:53.273675 --- ParallelTerminationStrategy: PID 19834 died... 22:10:53.292391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19834): Terminated: ok {rc=0} 22:10:53.337875 --- ParallelTerminationStrategy: PID 19837 died... 22:10:53.356732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19837): Terminated: ok {rc=0} 22:10:53.402111 --- ParallelTerminationStrategy: PID 19840 died... 22:10:53.421072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19840): Terminated: ok {rc=0} 22:10:53.508544 bus /gobi_0: Setting Powered False 22:10:54.609235 bus /gobi_0: Setting Powered False 22:10:55.723335 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 22:10:56.873539 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:56.886114 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:10:56.942996 tst iperf3.py: using LAC 17083 22:10:57.071017 tst iperf3.py: using RAC 253 22:10:57.201108 tst iperf3.py: using CellId 17083 22:10:57.329991 tst iperf3.py: using BVCI 17084 22:10:57.448252 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:57.460054 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:57.471681 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:57.483421 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:57.495216 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:57.506923 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:57.518827 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:57.530530 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:57.542460 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:10:57.663537 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:10:57.883228 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:10:58.207752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19842): Launched 22:10:58.489291 run iperf3-srv_10.42.42.10(pid=19843): Launched 22:10:58.610821 tst iperf3.py:8: start network... 22:10:58.830090 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:10:59.332684 run create_hlr_db(pid=19844): Launched 22:10:59.464412 bus /gobi_6: Setting Powered False 22:11:00.528806 run create_hlr_db(pid=19844): Terminated: ok {rc=0} 22:11:00.977767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19846): Launched 22:11:01.297315 run osmo-hlr_10.42.42.2(pid=19847): Launched 22:11:01.534939 run osmo-stp_10.42.42.5: Starting osmo-stp 22:11:02.178481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19849): Launched 22:11:02.489736 run osmo-stp_10.42.42.5(pid=19850): Launched 22:11:02.606700 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:11:03.131261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19852): Launched 22:11:03.247495 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:11:03.503204 run patchelf(pid=19853): Launched 22:11:03.672052 run osmo-stp_10.42.42.5(pid=19850): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19850)] 22:11:03.801074 run osmo-stp_10.42.42.5(pid=19850): stdout: | (launched: 2022-12-08_22:11:02.434969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:03.931601 run osmo-stp_10.42.42.5(pid=19850): stderr: | 20221208221102604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221102604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221102604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221102605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221102605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221102605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221102605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:04.062565 run osmo-stp_10.42.42.5(pid=19850): stdout: | (launched: 2022-12-08_22:11:02.434969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:04.188099 run osmo-stp_10.42.42.5(pid=19850): stderr: | 20221208221102604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221102604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221102604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221102605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221102605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221102605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221102605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:04.336224 run patchelf(pid=19853): Terminating (SIGINT) 22:11:04.507647 run patchelf(pid=19853): Terminated: ok {rc=0} 22:11:04.630991 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19850): Process ended prematurely: osmo-stp_10.42.42.5(pid=19850) [trial-2350↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19850)] [trial-2350↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 22:11:04.640527 tst iperf3.py:8: Test FAILED (7.8 sec) 22:11:04.669065 run osmo-hlr_10.42.42.2(pid=19847): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19847)] 22:11:04.717762 run osmo-hlr_10.42.42.2(pid=19847): stdout: | (launched: 2022-12-08_22:11:01.236755) 22:11:04.768416 run osmo-hlr_10.42.42.2(pid=19847): stderr: | 20221208221101591 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221101591 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221101591 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221101591 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221101591 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221101591 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221101603 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221101613 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221101613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221101613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:11:04.819403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19842): Terminating (SIGTERM) 22:11:04.859798 run iperf3-srv_10.42.42.10(pid=19843): Terminating (SIGTERM) 22:11:04.900201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19846): Terminating (SIGTERM) 22:11:04.940648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19849): Terminating (SIGTERM) 22:11:04.981457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19852): Terminating (SIGTERM) 22:11:05.022076 --- ParallelTerminationStrategy: PID 19842 died... 22:11:05.041363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19842): Terminated: ok {rc=0} 22:11:05.086611 --- ParallelTerminationStrategy: PID 19843 died... 22:11:05.105476 run iperf3-srv_10.42.42.10(pid=19843): Terminated {rc=256} 22:11:05.150829 --- ParallelTerminationStrategy: PID 19846 died... 22:11:05.169724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19846): Terminated: ok {rc=0} 22:11:05.215620 --- ParallelTerminationStrategy: PID 19849 died... 22:11:05.234627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19849): Terminated: ok {rc=0} 22:11:05.279518 --- ParallelTerminationStrategy: PID 19852 died... 22:11:05.298481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19852): Terminated: ok {rc=0} 22:11:05.385171 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 22:11:06.533844 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:06.545787 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:11:06.598985 tst iperf3m4.py: using LAC 17084 22:11:06.718994 tst iperf3m4.py: using RAC 254 22:11:06.841755 tst iperf3m4.py: using CellId 17084 22:11:06.964124 tst iperf3m4.py: using BVCI 17085 22:11:07.076729 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:07.088030 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:07.098953 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:07.110262 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:07.121551 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:07.132608 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:07.143914 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:07.154963 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:07.166073 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:11:07.285878 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:11:07.409745 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:11:07.528786 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:11:07.647348 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:11:07.851976 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:11:08.157801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19854): Launched 22:11:08.424164 run iperf3-srv_10.42.42.10(pid=19855): Launched 22:11:08.538450 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:11:08.742413 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:11:09.047571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19856): Launched 22:11:09.313212 run iperf3-srv_10.42.42.10(pid=19857): Launched 22:11:09.427509 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:11:09.630991 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:11:09.936614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19858): Launched 22:11:10.201191 run iperf3-srv_10.42.42.10(pid=19859): Launched 22:11:10.315267 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:11:10.518564 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:11:10.823396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19860): Launched 22:11:11.087829 run iperf3-srv_10.42.42.10(pid=19861): Launched 22:11:11.202077 tst iperf3m4.py:8: start network... 22:11:11.406622 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:11:11.876473 run create_hlr_db(pid=19862): Launched 22:11:11.992351 bus /gobi_6: Setting Powered False 22:11:13.054050 run create_hlr_db(pid=19862): Terminated: ok {rc=0} 22:11:13.477893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19864): Launched 22:11:13.780679 run osmo-hlr_10.42.42.2(pid=19865): Launched 22:11:13.896206 run osmo-stp_10.42.42.5: Starting osmo-stp 22:11:14.421482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19867): Launched 22:11:14.724620 run osmo-stp_10.42.42.5(pid=19868): Launched 22:11:14.839759 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:11:15.361944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19870): Launched 22:11:15.477878 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:11:15.733325 run patchelf(pid=19871): Launched 22:11:15.929882 run osmo-stp_10.42.42.5(pid=19868): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19868)] 22:11:16.066441 run osmo-stp_10.42.42.5(pid=19868): stdout: | (launched: 2022-12-08_22:11:14.669642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:16.200091 run osmo-stp_10.42.42.5(pid=19868): stderr: | 20221208221114840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221114840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221114840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221114841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221114841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221114841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221114841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:16.333961 run osmo-stp_10.42.42.5(pid=19868): stdout: | (launched: 2022-12-08_22:11:14.669642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:16.462595 run osmo-stp_10.42.42.5(pid=19868): stderr: | 20221208221114840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221114840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221114840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221114841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221114841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221114841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221114841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:16.614805 run patchelf(pid=19871): Terminating (SIGINT) 22:11:16.790085 run patchelf(pid=19871): Terminated: ok {rc=0} 22:11:16.916935 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19868): Process ended prematurely: osmo-stp_10.42.42.5(pid=19868) [trial-2350↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19868)] [trial-2350↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 22:11:16.927809 tst iperf3m4.py:8: Test FAILED (10.4 sec) 22:11:16.959244 run osmo-hlr_10.42.42.2(pid=19865): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19865)] 22:11:17.010947 run osmo-hlr_10.42.42.2(pid=19865): stdout: | (launched: 2022-12-08_22:11:13.725412) 22:11:17.064182 run osmo-hlr_10.42.42.2(pid=19865): stderr: | 20221208221113902 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221113902 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221113902 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221113902 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221113902 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221113903 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221113915 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221113923 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221113924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221113925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:11:17.117767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19854): Terminating (SIGTERM) 22:11:17.160746 run iperf3-srv_10.42.42.10(pid=19855): Terminating (SIGTERM) 22:11:17.203550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19856): Terminating (SIGTERM) 22:11:17.244845 run iperf3-srv_10.42.42.10(pid=19857): Terminating (SIGTERM) 22:11:17.285921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19858): Terminating (SIGTERM) 22:11:17.327341 run iperf3-srv_10.42.42.10(pid=19859): Terminating (SIGTERM) 22:11:17.368376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19860): Terminating (SIGTERM) 22:11:17.409613 run iperf3-srv_10.42.42.10(pid=19861): Terminating (SIGTERM) 22:11:17.450401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19864): Terminating (SIGTERM) 22:11:17.491348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19867): Terminating (SIGTERM) 22:11:17.532228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19870): Terminating (SIGTERM) 22:11:17.573474 --- ParallelTerminationStrategy: PID 19854 died... 22:11:17.593331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19854): Terminated: ok {rc=0} 22:11:17.638985 --- ParallelTerminationStrategy: PID 19855 died... 22:11:17.658126 run iperf3-srv_10.42.42.10(pid=19855): Terminated {rc=256} 22:11:17.703545 --- ParallelTerminationStrategy: PID 19856 died... 22:11:17.722660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19856): Terminated: ok {rc=0} 22:11:17.768334 --- ParallelTerminationStrategy: PID 19857 died... 22:11:17.787537 run iperf3-srv_10.42.42.10(pid=19857): Terminated {rc=256} 22:11:17.833124 --- ParallelTerminationStrategy: PID 19858 died... 22:11:17.852052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19858): Terminated: ok {rc=0} 22:11:17.897494 --- ParallelTerminationStrategy: PID 19859 died... 22:11:17.916534 run iperf3-srv_10.42.42.10(pid=19859): Terminated {rc=256} 22:11:17.962302 --- ParallelTerminationStrategy: PID 19860 died... 22:11:17.981410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19860): Terminated: ok {rc=0} 22:11:18.027009 --- ParallelTerminationStrategy: PID 19861 died... 22:11:18.046027 run iperf3-srv_10.42.42.10(pid=19861): Terminated {rc=256} 22:11:18.091488 --- ParallelTerminationStrategy: PID 19864 died... 22:11:18.110592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19864): Terminated: ok {rc=0} 22:11:18.156115 --- ParallelTerminationStrategy: PID 19867 died... 22:11:18.175063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19867): Terminated: ok {rc=0} 22:11:18.220552 --- ParallelTerminationStrategy: PID 19870 died... 22:11:18.239694 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19870): Terminated: ok {rc=0} 22:11:18.325533 bus /gobi_4: Setting Powered False 22:11:19.425563 bus /gobi_4: Setting Powered False 22:11:20.544025 bus /gobi_1: Setting Powered False 22:11:21.641670 bus /gobi_1: Setting Powered False 22:11:22.758724 bus /gobi_0: Setting Powered False 22:11:23.857610 bus /gobi_0: Setting Powered False 22:11:24.974929 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 22:11:26.079706 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:26.091911 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:11:26.148088 tst ping.py: using LAC 17085 22:11:26.265772 tst ping.py: using RAC 255 22:11:26.386680 tst ping.py: using CellId 17085 22:11:26.512854 tst ping.py: using BVCI 17086 22:11:26.628909 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:26.640687 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:26.652365 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:26.664079 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:26.675546 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:26.687017 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:26.698688 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:26.710135 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:11:26.827540 tst ping.py:19: start network... 22:11:27.040928 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:11:27.534586 run create_hlr_db(pid=19872): Launched 22:11:27.663805 bus /gobi_6: Setting Powered False 22:11:28.726955 run create_hlr_db(pid=19872): Terminated: ok {rc=0} 22:11:29.153291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19874): Launched 22:11:29.451213 run osmo-hlr_10.42.42.2(pid=19875): Launched 22:11:29.564650 run osmo-stp_10.42.42.5: Starting osmo-stp 22:11:30.087044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19877): Launched 22:11:30.384100 run osmo-stp_10.42.42.5(pid=19878): Launched 22:11:30.497926 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:11:31.040775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19880): Launched 22:11:31.168640 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:11:31.429671 run patchelf(pid=19881): Launched 22:11:31.616687 run osmo-stp_10.42.42.5(pid=19878): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19878)] 22:11:31.747739 run osmo-stp_10.42.42.5(pid=19878): stdout: | (launched: 2022-12-08_22:11:30.330192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:31.880333 run osmo-stp_10.42.42.5(pid=19878): stderr: | 20221208221130499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221130499 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221130499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221130500 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221130500 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221130500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221130501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:32.012906 run osmo-stp_10.42.42.5(pid=19878): stdout: | (launched: 2022-12-08_22:11:30.330192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:32.139728 run osmo-stp_10.42.42.5(pid=19878): stderr: | 20221208221130499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221130499 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221130499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221130500 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221130500 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221130500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221130501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:32.287473 run patchelf(pid=19881): Terminating (SIGINT) 22:11:32.456866 run patchelf(pid=19881): Terminated: ok {rc=0} 22:11:32.579370 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19878): Process ended prematurely: osmo-stp_10.42.42.5(pid=19878) [trial-2350↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19878)] [trial-2350↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 22:11:32.588429 tst ping.py:22: Test FAILED (6.5 sec) 22:11:32.616431 run osmo-hlr_10.42.42.2(pid=19875): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19875)] 22:11:32.665795 run osmo-hlr_10.42.42.2(pid=19875): stdout: | (launched: 2022-12-08_22:11:29.396864) 22:11:32.717153 run osmo-hlr_10.42.42.2(pid=19875): stderr: | 20221208221129575 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221129575 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221129575 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221129575 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221129575 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221129575 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221129592 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221129601 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221129601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221129601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:11:32.768741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19874): Terminating (SIGTERM) 22:11:32.810033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19877): Terminating (SIGTERM) 22:11:32.851149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19880): Terminating (SIGTERM) 22:11:32.892347 --- ParallelTerminationStrategy: PID 19874 died... 22:11:32.912086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19874): Terminated: ok {rc=0} 22:11:32.957641 --- ParallelTerminationStrategy: PID 19877 died... 22:11:32.976812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19877): Terminated: ok {rc=0} 22:11:33.023480 --- ParallelTerminationStrategy: PID 19880 died... 22:11:33.042562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19880): Terminated: ok {rc=0} 22:11:33.126886 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 22:11:34.211663 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:34.223493 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:11:34.276180 tst ping_idle_ping.py: using LAC 17086 22:11:34.395233 tst ping_idle_ping.py: using RAC 1 22:11:34.514224 tst ping_idle_ping.py: using CellId 17086 22:11:34.634030 tst ping_idle_ping.py: using BVCI 17087 22:11:34.744927 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:34.756110 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:34.767093 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:34.778385 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:34.789463 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:34.800627 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:34.812003 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:34.823281 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:11:34.938486 tst ping_idle_ping.py:24: start network... 22:11:35.138263 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:11:35.603220 run create_hlr_db(pid=19883): Launched 22:11:35.716881 bus /gobi_6: Setting Powered False 22:11:36.777472 run create_hlr_db(pid=19883): Terminated: ok {rc=0} 22:11:37.214668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19885): Launched 22:11:37.534645 run osmo-hlr_10.42.42.2(pid=19886): Launched 22:11:37.656898 run osmo-stp_10.42.42.5: Starting osmo-stp 22:11:38.206580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19888): Launched 22:11:38.524237 run osmo-stp_10.42.42.5(pid=19889): Launched 22:11:38.646768 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:11:39.199743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19891): Launched 22:11:39.322387 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:11:39.592366 run patchelf(pid=19892): Launched 22:11:39.770951 run osmo-stp_10.42.42.5(pid=19889): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19889)] 22:11:39.907295 run osmo-stp_10.42.42.5(pid=19889): stdout: | (launched: 2022-12-08_22:11:38.466736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:40.045271 run osmo-stp_10.42.42.5(pid=19889): stderr: | 20221208221138659 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221138659 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221138659 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221138659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221138660 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221138660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221138660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:40.182598 run osmo-stp_10.42.42.5(pid=19889): stdout: | (launched: 2022-12-08_22:11:38.466736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:40.314146 run osmo-stp_10.42.42.5(pid=19889): stderr: | 20221208221138659 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221138659 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221138659 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221138659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221138660 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221138660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221138660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:40.470051 run patchelf(pid=19892): Terminating (SIGINT) 22:11:40.650189 run patchelf(pid=19892): Terminated: ok {rc=0} 22:11:40.780078 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19889): Process ended prematurely: osmo-stp_10.42.42.5(pid=19889) [trial-2350↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19889)] [trial-2350↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 22:11:40.789953 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:11:40.818476 run osmo-hlr_10.42.42.2(pid=19886): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19886)] 22:11:40.869525 run osmo-hlr_10.42.42.2(pid=19886): stdout: | (launched: 2022-12-08_22:11:37.476799) 22:11:40.922531 run osmo-hlr_10.42.42.2(pid=19886): stderr: | 20221208221137674 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221137674 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221137674 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221137674 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221137674 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221137674 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221137691 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221137700 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221137700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221137701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:11:40.975659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19885): Terminating (SIGTERM) 22:11:41.018460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19888): Terminating (SIGTERM) 22:11:41.061338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19891): Terminating (SIGTERM) 22:11:41.104387 --- ParallelTerminationStrategy: PID 19885 died... 22:11:41.124741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19885): Terminated: ok {rc=0} 22:11:41.172006 --- ParallelTerminationStrategy: PID 19888 died... 22:11:41.191975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19888): Terminated: ok {rc=0} 22:11:41.239168 --- ParallelTerminationStrategy: PID 19891 died... 22:11:41.259240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19891): Terminated: ok {rc=0} 22:11:41.349985 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:11:42.665671 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:11:42.672612 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:11:42.706573 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:11:42.742212 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:11:42.794429 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:11:42.827898 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:11:42.862914 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:11:43.418195 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2350 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:11:43.423460 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:11:43.434810 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:11:43.502071 tst switch_tch_pdch.py: using LAC 17087 22:11:43.618422 tst switch_tch_pdch.py: using RAC 2 22:11:43.736280 tst switch_tch_pdch.py: using CellId 17087 22:11:43.852371 tst switch_tch_pdch.py: using BVCI 17088 22:11:43.960922 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:11:43.972082 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:11:43.982964 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:11:43.994267 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:11:44.005623 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:11:44.016775 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:11:44.028427 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:11:44.039940 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:11:44.159045 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:11:44.274219 tst switch_tch_pdch.py:51: start network... 22:11:44.473329 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:11:44.933154 run create_hlr_db(pid=19897): Launched 22:11:45.046964 bus /gobi_6: Setting Powered False 22:11:46.105822 run create_hlr_db(pid=19897): Terminated: ok {rc=0} 22:11:46.586045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19899): Launched 22:11:46.919301 run osmo-hlr_10.42.42.2(pid=19900): Launched 22:11:47.137271 run osmo-stp_10.42.42.5: Starting osmo-stp 22:11:47.689161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19902): Launched 22:11:48.006992 run osmo-stp_10.42.42.5(pid=19903): Launched 22:11:48.127015 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:11:48.675206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19905): Launched 22:11:48.797347 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:11:49.065443 run patchelf(pid=19906): Launched 22:11:49.242568 run osmo-stp_10.42.42.5(pid=19903): ERR: Terminated: ERROR {rc=1} [trial-2350↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19903)] 22:11:49.379184 run osmo-stp_10.42.42.5(pid=19903): stdout: | (launched: 2022-12-08_22:11:47.949309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:49.516651 run osmo-stp_10.42.42.5(pid=19903): stderr: | 20221208221148139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221148139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221148139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221148140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221148140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221148140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221148140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:49.654749 run osmo-stp_10.42.42.5(pid=19903): stdout: | (launched: 2022-12-08_22:11:47.949309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:49.787131 run osmo-stp_10.42.42.5(pid=19903): stderr: | 20221208221148139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221148139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221148139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221148140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221148140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221148140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221148140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:49.943193 run patchelf(pid=19906): Terminating (SIGINT) 22:11:50.123005 run patchelf(pid=19906): Terminated: ok {rc=0} 22:11:50.252105 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=19903): Process ended prematurely: osmo-stp_10.42.42.5(pid=19903) [trial-2350↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19903)] [trial-2350↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:11:50.261688 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 22:11:50.290108 run osmo-hlr_10.42.42.2(pid=19900): ERR: Terminated: ERROR {rc=237} [trial-2350↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19900)] 22:11:50.341324 run osmo-hlr_10.42.42.2(pid=19900): stdout: | (launched: 2022-12-08_22:11:46.857619) 22:11:50.394033 run osmo-hlr_10.42.42.2(pid=19900): stderr: | 20221208221147178 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221147178 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221147179 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221147179 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221147179 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221147179 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221147210 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221147218 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221147218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221147218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:11:50.447238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19899): Terminating (SIGTERM) 22:11:50.489947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19902): Terminating (SIGTERM) 22:11:50.532612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19905): Terminating (SIGTERM) 22:11:50.575646 --- ParallelTerminationStrategy: PID 19899 died... 22:11:50.596198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19899): Terminated: ok {rc=0} 22:11:50.643527 --- ParallelTerminationStrategy: PID 19902 died... 22:11:50.663587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19902): Terminated: ok {rc=0} 22:11:50.710706 --- ParallelTerminationStrategy: PID 19905 died... 22:11:50.730627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19905): Terminated: ok {rc=0} 22:11:50.819655 bus /gobi_0: Setting Powered False 22:11:51.919649 bus /gobi_0: Setting Powered False 22:11:53.036160 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 22:11:54.291043 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:11:54.297322 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 22:11:54.331482 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 22:11:54.366647 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 22:11:54.421168 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 22:11:54.455242 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 22:11:54.489996 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 22:11:55.043702 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2350 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 22:11:55.048724 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:11:55.060004 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 22:11:55.130732 tst switch_tch_pdch.py: using LAC 17088 22:11:55.256455 tst switch_tch_pdch.py: using RAC 3 22:11:55.381591 tst switch_tch_pdch.py: using CellId 17088 22:11:55.506264 tst switch_tch_pdch.py: using BVCI 17089 22:11:55.623692 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:11:55.635113 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:11:55.646294 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:11:55.657439 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:11:55.668562 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:11:55.679708 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:11:55.690958 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:11:55.702140 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:11:55.818343 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:11:55.933041 tst switch_tch_pdch.py:51: start network... 22:11:56.133124 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:11:56.568057 run create_hlr_db(pid=19910): Launched 22:11:56.682230 bus /gobi_6: Setting Powered False 22:11:57.741740 run create_hlr_db(pid=19910): Terminated: ok {rc=0} 22:11:58.149528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19912): Launched 22:11:58.467033 run osmo-hlr_10.42.42.2(pid=19913): Launched 22:11:58.588475 run osmo-stp_10.42.42.5: Starting osmo-stp 22:11:59.111189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19915): Launched 22:11:59.428324 run osmo-stp_10.42.42.5(pid=19916): Launched 22:11:59.549211 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:12:00.070359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19918): Launched 22:12:00.191126 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:12:00.458927 run patchelf(pid=19919): Launched 22:12:00.635562 run osmo-stp_10.42.42.5(pid=19916): ERR: Terminated: ERROR {rc=1} [trial-2350↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19916)] 22:12:00.771955 run osmo-stp_10.42.42.5(pid=19916): stdout: | (launched: 2022-12-08_22:11:59.371130) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:00.921444 run osmo-stp_10.42.42.5(pid=19916): stderr: | 20221208221159562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221159562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221159562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221159563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221159565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221159565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221159565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:01.082396 run osmo-stp_10.42.42.5(pid=19916): stdout: | (launched: 2022-12-08_22:11:59.371130) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:01.239155 run osmo-stp_10.42.42.5(pid=19916): stderr: | 20221208221159562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221159562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221159562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221159563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221159565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221159565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221159565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:01.391738 run patchelf(pid=19919): Terminating (SIGINT) 22:12:01.567191 run patchelf(pid=19919): Terminated: ok {rc=0} 22:12:01.694114 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=19916): Process ended prematurely: osmo-stp_10.42.42.5(pid=19916) [trial-2350↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19916)] [trial-2350↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 22:12:01.704268 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 22:12:01.735591 run osmo-hlr_10.42.42.2(pid=19913): ERR: Terminated: ERROR {rc=237} [trial-2350↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19913)] 22:12:01.787013 run osmo-hlr_10.42.42.2(pid=19913): stdout: | (launched: 2022-12-08_22:11:58.409671) 22:12:01.839879 run osmo-hlr_10.42.42.2(pid=19913): stderr: | 20221208221158604 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221158604 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221158604 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221158604 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221158604 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221158604 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221158617 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221158625 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221158625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221158625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:12:01.894223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19912): Terminating (SIGTERM) 22:12:01.939030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19915): Terminating (SIGTERM) 22:12:01.984056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19918): Terminating (SIGTERM) 22:12:02.029721 --- ParallelTerminationStrategy: PID 19912 died... 22:12:02.049766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19912): Terminated: ok {rc=0} 22:12:02.099484 --- ParallelTerminationStrategy: PID 19915 died... 22:12:02.119107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19915): Terminated: ok {rc=0} 22:12:02.168343 --- ParallelTerminationStrategy: PID 19918 died... 22:12:02.188684 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19918): Terminated: ok {rc=0} 22:12:02.275015 bus /gobi_0: Setting Powered False 22:12:03.374280 bus /gobi_0: Setting Powered False 22:12:04.492607 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 22:12:05.742322 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:12:05.746208 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 22:12:05.779404 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 22:12:05.785986 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 22:12:05.836854 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 22:12:05.869711 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 22:12:05.876230 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 22:12:06.414603 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 22:12:06.419317 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 22:12:06.430083 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:12:06.481504 tst mo_mt_sms.py: using LAC 17089 22:12:06.600144 tst mo_mt_sms.py: using RAC 4 22:12:06.717766 tst mo_mt_sms.py: using CellId 17089 22:12:06.844905 tst mo_mt_sms.py: using BVCI 17090 22:12:06.960313 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 22:12:07.073812 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 22:12:07.185213 tst mo_mt_sms.py:9: start nitb and bts... 22:12:07.385851 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:12:07.992214 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19923): Launched 22:12:08.289079 run osmo-nitb_10.42.42.2(pid=19924): Launched 22:12:08.454216 run osmo-nitb_10.42.42.2(pid=19924): ERR: Terminated: ERROR {rc=2} [trial-2350↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19924)] 22:12:08.588816 run osmo-nitb_10.42.42.2(pid=19924): stdout: | (launched: 2022-12-08_22:12:08.235008) 22:12:08.725392 run osmo-nitb_10.42.42.2(pid=19924): stderr: | (launched: 2022-12-08_22:12:08.279204) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:12:08.861396 run osmo-nitb_10.42.42.2(pid=19924): stdout: | (launched: 2022-12-08_22:12:08.235008) 22:12:08.991857 run osmo-nitb_10.42.42.2(pid=19924): stderr: | (launched: 2022-12-08_22:12:08.279204) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3c9519268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=19924): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19924) [trial-2350↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19924)] 22:12:09.401595 tst osmo-nitb_10.42.42.2(pid=19924): stdout: | (launched: 2022-12-08_22:12:08.235008) 22:12:09.521811 tst osmo-nitb_10.42.42.2(pid=19924): stderr: | (launched: 2022-12-08_22:12:08.279204) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:12:09.663757 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=19924): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19924) [trial-2350↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19924)] [trial-2350↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 22:12:09.672178 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 22:12:09.678740 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19923): Terminating (SIGTERM) 22:12:09.888888 --- ParallelTerminationStrategy: PID 19923 died... 22:12:09.909469 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19923): Terminated: ok {rc=0} 22:12:09.996448 bus /sierra_3: Setting Powered False 22:12:11.099996 bus /sierra_3: Setting Powered False 22:12:12.219415 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 sms:trx-sysmocell5000 --------------------------------------------------------------------- 22:12:13.414690 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:12:13.418646 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 22:12:13.451908 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 22:12:13.478126 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 22:12:13.529224 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 22:12:13.563286 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 22:12:13.589238 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 22:12:14.134313 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 22:12:14.139166 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:14.149701 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:12:14.196530 tst mo_mt_sms.py: using LAC 17090 22:12:14.316468 tst mo_mt_sms.py: using RAC 5 22:12:14.431849 tst mo_mt_sms.py: using CellId 17090 22:12:14.556597 tst mo_mt_sms.py: using BVCI 17091 22:12:14.673319 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:14.684426 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:14.695607 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:14.707297 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:14.719320 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:14.730869 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 22:12:14.844896 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 22:12:14.961989 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:12:15.456221 run create_hlr_db(pid=19928): Launched 22:12:15.584796 bus /sierra_2: Setting Powered False 22:12:16.655734 run create_hlr_db(pid=19928): Terminated: ok {rc=0} 22:12:17.185136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19930): Launched 22:12:17.511320 run osmo-hlr_10.42.42.2(pid=19931): Launched 22:12:17.631707 run osmo-stp_10.42.42.5: Starting osmo-stp 22:12:18.182945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19933): Launched 22:12:18.499496 run osmo-stp_10.42.42.5(pid=19934): Launched 22:12:18.619506 run osmo-msc_10.42.42.6: Starting osmo-msc 22:12:19.192819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19936): Launched 22:12:19.508834 run osmo-msc_10.42.42.6(pid=19937): Launched 22:12:19.684569 run osmo-stp_10.42.42.5(pid=19934): ERR: Terminated: ERROR {rc=1} [trial-2350↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19934)] 22:12:19.819998 run osmo-stp_10.42.42.5(pid=19934): stdout: | (launched: 2022-12-08_22:12:18.442264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:19.955307 run osmo-stp_10.42.42.5(pid=19934): stderr: | 20221208221218633 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221218634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221218634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221218634 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221218637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221218637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221218637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:20.090338 run osmo-stp_10.42.42.5(pid=19934): stdout: | (launched: 2022-12-08_22:12:18.442264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:20.216813 run osmo-stp_10.42.42.5(pid=19934): stderr: | 20221208221218633 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221218634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221218634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221218634 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221218637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221218637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221218637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:20.368520 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=19934): Process ended prematurely: osmo-stp_10.42.42.5(pid=19934) [trial-2350↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19934)] [trial-2350↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 22:12:20.377609 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 22:12:20.405000 run osmo-hlr_10.42.42.2(pid=19931): ERR: Terminated: ERROR {rc=237} [trial-2350↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19931)] 22:12:20.455914 run osmo-hlr_10.42.42.2(pid=19931): stdout: | (launched: 2022-12-08_22:12:17.454163) 22:12:20.508154 run osmo-hlr_10.42.42.2(pid=19931): stderr: | 20221208221217651 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221217651 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221217651 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221217651 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221217651 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221217651 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221217664 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221217672 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221217673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221217673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:12:20.580899 run osmo-msc_10.42.42.6(pid=19937): ERR: Terminated: ERROR {rc=2} [trial-2350↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19937)] 22:12:20.631362 run osmo-msc_10.42.42.6(pid=19937): stdout: | (launched: 2022-12-08_22:12:19.451452) 22:12:20.683501 run osmo-msc_10.42.42.6(pid=19937): stderr: | 20221208221219774 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208221219774 DLGLOBAL DEBUG validating counter group 0x7f82baad5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208221219774 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208221219774 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208221219774 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208221219775 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208221219776 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208221219777 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208221219777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208221219777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:12:20.736039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19930): Terminating (SIGTERM) 22:12:20.778601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19933): Terminating (SIGTERM) 22:12:20.820836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19936): Terminating (SIGTERM) 22:12:20.863145 --- ParallelTerminationStrategy: PID 19930 died... 22:12:20.883344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19930): Terminated: ok {rc=0} 22:12:20.930051 --- ParallelTerminationStrategy: PID 19933 died... 22:12:20.949836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19933): Terminated: ok {rc=0} 22:12:20.996329 --- ParallelTerminationStrategy: PID 19936 died... 22:12:21.015924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19936): Terminated: ok {rc=0} 22:12:21.103816 bus /sierra_3: Setting Powered False 22:12:22.203841 bus /sierra_3: Setting Powered False 22:12:23.320179 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 22:12:24.553777 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:12:24.557625 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 22:12:24.591498 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 22:12:24.598149 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 22:12:24.630767 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 22:12:24.663889 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 22:12:24.670489 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 22:12:25.191712 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2350 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 22:12:25.196726 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 22:12:25.207821 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:12:25.254630 tst assert_extension.py: using LAC 17091 22:12:25.369652 tst assert_extension.py: using RAC 6 22:12:25.486633 tst assert_extension.py: using CellId 17091 22:12:25.601382 tst assert_extension.py: using BVCI 17092 22:12:25.708484 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 22:12:25.824265 tst assert_extension.py:10: start nitb and bts... 22:12:26.038665 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:12:26.685484 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19942): Launched 22:12:27.004172 run osmo-nitb_10.42.42.2(pid=19943): Launched 22:12:27.180214 run osmo-nitb_10.42.42.2(pid=19943): ERR: Terminated: ERROR {rc=2} [trial-2350↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19943)] 22:12:27.323547 run osmo-nitb_10.42.42.2(pid=19943): stdout: | (launched: 2022-12-08_22:12:26.946575) 22:12:27.468696 run osmo-nitb_10.42.42.2(pid=19943): stderr: | (launched: 2022-12-08_22:12:26.994358) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:12:27.613494 run osmo-nitb_10.42.42.2(pid=19943): stdout: | (launched: 2022-12-08_22:12:26.946575) 22:12:27.752449 run osmo-nitb_10.42.42.2(pid=19943): stderr: | (launched: 2022-12-08_22:12:26.994358) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3c9519268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=19943): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19943) [trial-2350↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19943)] 22:12:28.123595 tst osmo-nitb_10.42.42.2(pid=19943): stdout: | (launched: 2022-12-08_22:12:26.946575) 22:12:28.252904 tst osmo-nitb_10.42.42.2(pid=19943): stderr: | (launched: 2022-12-08_22:12:26.994358) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:12:28.404037 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=19943): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19943) [trial-2350↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19943)] [trial-2350↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 22:12:28.413248 tst assert_extension.py:12: Test FAILED (3.2 sec) 22:12:28.420306 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19942): Terminating (SIGTERM) 22:12:28.631536 --- ParallelTerminationStrategy: PID 19942 died... 22:12:28.653537 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19942): Terminated: ok {rc=0} 22:12:28.743043 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 22:12:29.920648 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:12:29.924549 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 22:12:29.958636 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 22:12:29.985306 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 22:12:30.020119 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 22:12:30.053670 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 22:12:30.080213 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 22:12:30.610716 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2350 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 22:12:30.615888 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:30.626685 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:12:30.678714 tst assert_extension.py: using LAC 17092 22:12:30.796375 tst assert_extension.py: using RAC 7 22:12:30.945926 tst assert_extension.py: using CellId 17092 22:12:31.071035 tst assert_extension.py: using BVCI 17093 22:12:31.182853 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:31.194159 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:31.205379 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:31.217201 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:31.228841 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:31.240664 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 22:12:31.364475 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:12:31.879714 run create_hlr_db(pid=19947): Launched 22:12:32.034523 bus /sierra_2: Setting Powered False 22:12:33.094384 run create_hlr_db(pid=19947): Terminated: ok {rc=0} 22:12:33.531881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19949): Launched 22:12:33.852367 run osmo-hlr_10.42.42.2(pid=19950): Launched 22:12:33.973628 run osmo-stp_10.42.42.5: Starting osmo-stp 22:12:34.609563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19952): Launched 22:12:34.923710 run osmo-stp_10.42.42.5(pid=19953): Launched 22:12:35.043065 run osmo-msc_10.42.42.6: Starting osmo-msc 22:12:35.606412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19955): Launched 22:12:35.919755 run osmo-msc_10.42.42.6(pid=19957): Launched 22:12:36.094073 run osmo-stp_10.42.42.5(pid=19953): ERR: Terminated: ERROR {rc=1} [trial-2350↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19953)] 22:12:36.227241 run osmo-stp_10.42.42.5(pid=19953): stdout: | (launched: 2022-12-08_22:12:34.867178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:36.360169 run osmo-stp_10.42.42.5(pid=19953): stderr: | 20221208221235056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221235056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221235056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221235056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221235057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221235057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221235057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:36.492835 run osmo-stp_10.42.42.5(pid=19953): stdout: | (launched: 2022-12-08_22:12:34.867178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:36.618093 run osmo-stp_10.42.42.5(pid=19953): stderr: | 20221208221235056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221235056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221235056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221235056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221235057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221235057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221235057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:36.767846 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=19953): Process ended prematurely: osmo-stp_10.42.42.5(pid=19953) [trial-2350↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19953)] [trial-2350↪ussd:trx-sysmocell5000↪assert_extension.py:17] 22:12:36.777218 tst assert_extension.py:17: Test FAILED (6.2 sec) 22:12:36.804762 run osmo-hlr_10.42.42.2(pid=19950): ERR: Terminated: ERROR {rc=237} [trial-2350↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19950)] 22:12:36.855529 run osmo-hlr_10.42.42.2(pid=19950): stdout: | (launched: 2022-12-08_22:12:33.794948) 22:12:36.907927 run osmo-hlr_10.42.42.2(pid=19950): stderr: | 20221208221233991 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221233991 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221233991 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221233991 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221233991 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221233992 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221234004 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221234012 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221234012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221234012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:12:36.980712 run osmo-msc_10.42.42.6(pid=19957): ERR: Terminated: ERROR {rc=2} [trial-2350↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19957)] 22:12:37.031404 run osmo-msc_10.42.42.6(pid=19957): stdout: | (launched: 2022-12-08_22:12:35.863229) 22:12:37.083708 run osmo-msc_10.42.42.6(pid=19957): stderr: | 20221208221236184 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208221236184 DLGLOBAL DEBUG validating counter group 0x7f39f37a0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208221236184 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208221236185 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208221236185 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208221236185 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208221236187 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208221236187 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208221236187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208221236187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:12:37.136447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19949): Terminating (SIGTERM) 22:12:37.178614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19952): Terminating (SIGTERM) 22:12:37.220866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19955): Terminating (SIGTERM) 22:12:37.263239 --- ParallelTerminationStrategy: PID 19949 died... 22:12:37.283326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19949): Terminated: ok {rc=0} 22:12:37.330341 --- ParallelTerminationStrategy: PID 19952 died... 22:12:37.349884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19952): Terminated: ok {rc=0} 22:12:37.396014 --- ParallelTerminationStrategy: PID 19955 died... 22:12:37.415422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19955): Terminated: ok {rc=0} 22:12:37.502444 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:12:38.724027 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:12:38.732441 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:12:38.766802 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:12:38.793867 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:12:38.844366 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:12:38.878056 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:12:38.904704 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:12:39.460034 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:12:39.510613 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:39.521908 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:12:39.589638 tst mo_mt_call.py: using LAC 17093 22:12:39.706348 tst mo_mt_call.py: using RAC 8 22:12:39.823822 tst mo_mt_call.py: using CellId 17093 22:12:39.941530 tst mo_mt_call.py: using BVCI 17094 22:12:40.058552 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:40.070097 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:40.081477 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:40.092831 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:40.104338 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:40.115856 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:12:40.230119 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:12:40.348264 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:12:40.843393 run create_hlr_db(pid=19962): Launched 22:12:40.973346 bus /sierra_2: Setting Powered False 22:12:42.037336 run create_hlr_db(pid=19962): Terminated: ok {rc=0} 22:12:42.465026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19964): Launched 22:12:42.785882 run osmo-hlr_10.42.42.2(pid=19965): Launched 22:12:42.906500 run osmo-stp_10.42.42.5: Starting osmo-stp 22:12:43.459084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19967): Launched 22:12:43.777318 run osmo-stp_10.42.42.5(pid=19968): Launched 22:12:43.898845 run osmo-msc_10.42.42.6: Starting osmo-msc 22:12:44.479536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19970): Launched 22:12:44.798739 run osmo-msc_10.42.42.6(pid=19971): Launched 22:12:44.976467 run osmo-stp_10.42.42.5(pid=19968): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19968)] 22:12:45.115565 run osmo-stp_10.42.42.5(pid=19968): stdout: | (launched: 2022-12-08_22:12:43.719737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:45.252252 run osmo-stp_10.42.42.5(pid=19968): stderr: | 20221208221243910 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221243910 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221243910 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221243911 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221243913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221243913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221243913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:45.386384 run osmo-stp_10.42.42.5(pid=19968): stdout: | (launched: 2022-12-08_22:12:43.719737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:45.514274 run osmo-stp_10.42.42.5(pid=19968): stderr: | 20221208221243910 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221243910 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221243910 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221243911 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221243913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221243913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221243913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:45.667411 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19968): Process ended prematurely: osmo-stp_10.42.42.5(pid=19968) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19968)] [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:12:45.677000 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:12:45.704755 run osmo-hlr_10.42.42.2(pid=19965): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19965)] 22:12:45.755783 run osmo-hlr_10.42.42.2(pid=19965): stdout: | (launched: 2022-12-08_22:12:42.728133) 22:12:45.808831 run osmo-hlr_10.42.42.2(pid=19965): stderr: | 20221208221242928 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221242928 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221242928 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221242928 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221242928 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221242928 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221242941 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221242949 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221242949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221242949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:12:45.903213 run osmo-msc_10.42.42.6(pid=19971): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19971)] 22:12:45.956458 run osmo-msc_10.42.42.6(pid=19971): stdout: | (launched: 2022-12-08_22:12:44.740922) 22:12:46.010257 run osmo-msc_10.42.42.6(pid=19971): stderr: | 20221208221245061 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208221245062 DLGLOBAL DEBUG validating counter group 0x7f82513bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208221245062 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208221245062 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208221245062 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208221245062 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208221245064 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208221245064 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208221245064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208221245064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:12:46.064282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19964): Terminating (SIGTERM) 22:12:46.108097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19967): Terminating (SIGTERM) 22:12:46.153511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19970): Terminating (SIGTERM) 22:12:46.198116 --- ParallelTerminationStrategy: PID 19964 died... 22:12:46.218524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19964): Terminated: ok {rc=0} 22:12:46.266144 --- ParallelTerminationStrategy: PID 19967 died... 22:12:46.286470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19967): Terminated: ok {rc=0} 22:12:46.334525 --- ParallelTerminationStrategy: PID 19970 died... 22:12:46.354697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19970): Terminated: ok {rc=0} 22:12:46.443747 bus /sierra_3: Setting Powered False 22:12:47.543658 bus /sierra_3: Setting Powered False 22:12:48.659450 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:12:49.810158 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:49.822369 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:12:49.895374 tst mo_mt_call_osmux.py: using LAC 17094 22:12:50.022656 tst mo_mt_call_osmux.py: using RAC 9 22:12:50.150212 tst mo_mt_call_osmux.py: using CellId 17094 22:12:50.277207 tst mo_mt_call_osmux.py: using BVCI 17095 22:12:50.393510 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:50.405093 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:50.416495 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:50.427874 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:50.439300 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:50.450690 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:12:50.565608 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:12:50.685532 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:12:51.181218 run create_hlr_db(pid=19973): Launched 22:12:51.310338 bus /sierra_2: Setting Powered False 22:12:52.374480 run create_hlr_db(pid=19973): Terminated: ok {rc=0} 22:12:52.803039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19975): Launched 22:12:53.101877 run osmo-hlr_10.42.42.2(pid=19976): Launched 22:12:53.215648 run osmo-stp_10.42.42.5: Starting osmo-stp 22:12:53.731457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19978): Launched 22:12:54.030376 run osmo-stp_10.42.42.5(pid=19979): Launched 22:12:54.143983 run osmo-msc_10.42.42.6: Starting osmo-msc 22:12:54.685533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19981): Launched 22:12:54.986206 run osmo-msc_10.42.42.6(pid=19982): Launched 22:12:55.153259 run osmo-stp_10.42.42.5(pid=19979): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19979)] 22:12:55.281832 run osmo-stp_10.42.42.5(pid=19979): stdout: | (launched: 2022-12-08_22:12:53.976243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:55.410197 run osmo-stp_10.42.42.5(pid=19979): stderr: | 20221208221254147 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221254147 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221254147 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221254148 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221254148 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221254148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221254148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:55.535835 run osmo-stp_10.42.42.5(pid=19979): stdout: | (launched: 2022-12-08_22:12:53.976243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:55.655615 run osmo-stp_10.42.42.5(pid=19979): stderr: | 20221208221254147 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221254147 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221254147 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221254148 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221254148 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221254148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221254148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:55.799074 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19979): Process ended prematurely: osmo-stp_10.42.42.5(pid=19979) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19979)] [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:12:55.807920 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 22:12:55.835180 run osmo-hlr_10.42.42.2(pid=19976): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19976)] 22:12:55.883580 run osmo-hlr_10.42.42.2(pid=19976): stdout: | (launched: 2022-12-08_22:12:53.047916) 22:12:55.933829 run osmo-hlr_10.42.42.2(pid=19976): stderr: | 20221208221253222 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221253222 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221253222 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221253222 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221253222 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221253222 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221253234 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221253243 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221253243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221253243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:12:56.003424 run osmo-msc_10.42.42.6(pid=19982): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19982)] 22:12:56.051593 run osmo-msc_10.42.42.6(pid=19982): stdout: | (launched: 2022-12-08_22:12:54.931607) 22:12:56.101855 run osmo-msc_10.42.42.6(pid=19982): stderr: | 20221208221255201 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208221255201 DLGLOBAL DEBUG validating counter group 0x7f5ef409bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208221255201 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208221255201 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208221255201 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208221255202 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208221255206 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208221255206 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208221255206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208221255206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:12:56.152348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19975): Terminating (SIGTERM) 22:12:56.192447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19978): Terminating (SIGTERM) 22:12:56.232361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19981): Terminating (SIGTERM) 22:12:56.272666 --- ParallelTerminationStrategy: PID 19975 died... 22:12:56.291898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19975): Terminated: ok {rc=0} 22:12:56.337110 --- ParallelTerminationStrategy: PID 19978 died... 22:12:56.355742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19978): Terminated: ok {rc=0} 22:12:56.401292 --- ParallelTerminationStrategy: PID 19981 died... 22:12:56.419957 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19981): Terminated: ok {rc=0} 22:12:56.507001 bus /sierra_3: Setting Powered False 22:12:57.606040 bus /sierra_3: Setting Powered False 22:12:58.720503 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:12:59.966279 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:12:59.972643 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:13:00.006326 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:13:00.032119 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:13:00.082913 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:13:00.116182 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:13:00.142390 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:13:00.694059 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:13:00.742656 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:00.753772 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:13:00.829197 tst mo_mt_call.py: using LAC 17095 22:13:00.993336 tst mo_mt_call.py: using RAC 10 22:13:01.156092 tst mo_mt_call.py: using CellId 17095 22:13:01.290115 tst mo_mt_call.py: using BVCI 17096 22:13:01.414298 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:01.426791 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:01.439092 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:01.451285 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:01.463595 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:01.475901 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:13:01.614645 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:13:01.756186 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:13:02.276258 run create_hlr_db(pid=19987): Launched 22:13:02.407765 bus /sierra_2: Setting Powered False 22:13:03.472191 run create_hlr_db(pid=19987): Terminated: ok {rc=0} 22:13:03.917343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19989): Launched 22:13:04.238457 run osmo-hlr_10.42.42.2(pid=19990): Launched 22:13:04.359600 run osmo-stp_10.42.42.5: Starting osmo-stp 22:13:04.910377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19992): Launched 22:13:05.228799 run osmo-stp_10.42.42.5(pid=19993): Launched 22:13:05.350079 run osmo-msc_10.42.42.6: Starting osmo-msc 22:13:05.932816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19995): Launched 22:13:06.252227 run osmo-msc_10.42.42.6(pid=19996): Launched 22:13:06.430091 run osmo-stp_10.42.42.5(pid=19993): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19993)] 22:13:06.566406 run osmo-stp_10.42.42.5(pid=19993): stdout: | (launched: 2022-12-08_22:13:05.171626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:06.702863 run osmo-stp_10.42.42.5(pid=19993): stderr: | 20221208221305362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221305362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221305363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221305363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221305364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221305364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221305364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:06.839113 run osmo-stp_10.42.42.5(pid=19993): stdout: | (launched: 2022-12-08_22:13:05.171626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:06.966809 run osmo-stp_10.42.42.5(pid=19993): stderr: | 20221208221305362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221305362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221305363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221305363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221305364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221305364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221305364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:07.119769 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19993): Process ended prematurely: osmo-stp_10.42.42.5(pid=19993) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19993)] [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:13:07.129447 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 22:13:07.157389 run osmo-hlr_10.42.42.2(pid=19990): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19990)] 22:13:07.208132 run osmo-hlr_10.42.42.2(pid=19990): stdout: | (launched: 2022-12-08_22:13:04.180474) 22:13:07.260637 run osmo-hlr_10.42.42.2(pid=19990): stderr: | 20221208221304380 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221304380 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221304380 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221304380 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221304380 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221304380 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221304394 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221304402 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221304402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221304402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:13:07.333900 run osmo-msc_10.42.42.6(pid=19996): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19996)] 22:13:07.384529 run osmo-msc_10.42.42.6(pid=19996): stdout: | (launched: 2022-12-08_22:13:06.194693) 22:13:07.437166 run osmo-msc_10.42.42.6(pid=19996): stderr: | 20221208221306514 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208221306514 DLGLOBAL DEBUG validating counter group 0x7f9097e95c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208221306514 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208221306514 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208221306514 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208221306514 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208221306518 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208221306518 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208221306518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208221306519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:13:07.489949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19989): Terminating (SIGTERM) 22:13:07.531913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19992): Terminating (SIGTERM) 22:13:07.573792 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19995): Terminating (SIGTERM) 22:13:07.616028 --- ParallelTerminationStrategy: PID 19989 died... 22:13:07.635931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19989): Terminated: ok {rc=0} 22:13:07.682615 --- ParallelTerminationStrategy: PID 19992 died... 22:13:07.702142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19992): Terminated: ok {rc=0} 22:13:07.748331 --- ParallelTerminationStrategy: PID 19995 died... 22:13:07.768001 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19995): Terminated: ok {rc=0} 22:13:07.857284 bus /sierra_3: Setting Powered False 22:13:08.957390 bus /sierra_3: Setting Powered False 22:13:10.073612 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:13:11.221297 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:11.233488 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:13:11.310101 tst mo_mt_call_osmux.py: using LAC 17096 22:13:11.436336 tst mo_mt_call_osmux.py: using RAC 11 22:13:11.559068 tst mo_mt_call_osmux.py: using CellId 17096 22:13:11.678607 tst mo_mt_call_osmux.py: using BVCI 17097 22:13:11.788940 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:11.800286 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:11.811256 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:11.822598 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:11.833846 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:11.845080 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:13:11.962773 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:13:12.075744 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:13:12.542636 run create_hlr_db(pid=19998): Launched 22:13:12.658304 bus /sierra_2: Setting Powered False 22:13:13.718972 run create_hlr_db(pid=19998): Terminated: ok {rc=0} 22:13:14.137966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20000): Launched 22:13:14.437475 run osmo-hlr_10.42.42.2(pid=20001): Launched 22:13:14.552507 run osmo-stp_10.42.42.5: Starting osmo-stp 22:13:15.070075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20003): Launched 22:13:15.369936 run osmo-stp_10.42.42.5(pid=20004): Launched 22:13:15.484736 run osmo-msc_10.42.42.6: Starting osmo-msc 22:13:16.085740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20006): Launched 22:13:16.416781 run osmo-msc_10.42.42.6(pid=20007): Launched 22:13:16.945231 run osmo-stp_10.42.42.5(pid=20004): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20004)] 22:13:17.211722 run osmo-stp_10.42.42.5(pid=20004): stdout: | (launched: 2022-12-08_22:13:15.315478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:17.347374 run osmo-stp_10.42.42.5(pid=20004): stderr: | 20221208221315483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221315483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221315484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221315484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221315485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221315485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221315485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:17.482535 run osmo-stp_10.42.42.5(pid=20004): stdout: | (launched: 2022-12-08_22:13:15.315478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:17.611106 run osmo-stp_10.42.42.5(pid=20004): stderr: | 20221208221315483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221315483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221315484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221315484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221315485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221315485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221315485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:17.764490 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20004): Process ended prematurely: osmo-stp_10.42.42.5(pid=20004) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20004)] [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:13:17.774304 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 22:13:17.802733 run osmo-hlr_10.42.42.2(pid=20001): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20001)] 22:13:17.853732 run osmo-hlr_10.42.42.2(pid=20001): stdout: | (launched: 2022-12-08_22:13:14.383281) 22:13:17.906463 run osmo-hlr_10.42.42.2(pid=20001): stderr: | 20221208221314557 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221314557 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221314557 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221314557 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221314557 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221314557 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221314607 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221314616 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221314617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221314617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:13:17.979653 run osmo-msc_10.42.42.6(pid=20007): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20007)] 22:13:18.030409 run osmo-msc_10.42.42.6(pid=20007): stdout: | (launched: 2022-12-08_22:13:16.349652) 22:13:18.082922 run osmo-msc_10.42.42.6(pid=20007): stderr: | 20221208221316825 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208221316826 DLGLOBAL DEBUG validating counter group 0x7f1f1ae6dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208221316827 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208221316827 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208221316828 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208221316828 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208221316833 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208221316835 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208221316835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208221316835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:13:18.135680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20000): Terminating (SIGTERM) 22:13:18.178103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20003): Terminating (SIGTERM) 22:13:18.220651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20006): Terminating (SIGTERM) 22:13:18.263601 --- ParallelTerminationStrategy: PID 20000 died... 22:13:18.283985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20000): Terminated: ok {rc=0} 22:13:18.330862 --- ParallelTerminationStrategy: PID 20003 died... 22:13:18.350516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20003): Terminated: ok {rc=0} 22:13:18.397219 --- ParallelTerminationStrategy: PID 20006 died... 22:13:18.416809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20006): Terminated: ok {rc=0} 22:13:18.505768 bus /sierra_3: Setting Powered False 22:13:19.606504 bus /sierra_3: Setting Powered False 22:13:20.724687 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:13:21.977834 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:13:21.984486 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:13:22.017508 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:13:22.044861 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:13:22.095464 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:13:22.128475 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:13:22.154617 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:13:22.707299 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:13:22.755944 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:22.767117 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:13:22.844139 tst mo_mt_call.py: using LAC 17097 22:13:22.971614 tst mo_mt_call.py: using RAC 12 22:13:23.097077 tst mo_mt_call.py: using CellId 17097 22:13:23.221865 tst mo_mt_call.py: using BVCI 17098 22:13:23.338809 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:23.350618 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:23.362164 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:23.373693 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:23.385274 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:23.396766 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:13:23.512024 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:13:23.625308 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:13:24.092116 run create_hlr_db(pid=20012): Launched 22:13:24.208444 bus /sierra_2: Setting Powered False 22:13:25.268784 run create_hlr_db(pid=20012): Terminated: ok {rc=0} 22:13:25.688303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20014): Launched 22:13:25.988931 run osmo-hlr_10.42.42.2(pid=20015): Launched 22:13:26.104209 run osmo-stp_10.42.42.5: Starting osmo-stp 22:13:26.635264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20017): Launched 22:13:26.935462 run osmo-stp_10.42.42.5(pid=20018): Launched 22:13:27.050431 run osmo-msc_10.42.42.6: Starting osmo-msc 22:13:27.593648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20020): Launched 22:13:27.894846 run osmo-msc_10.42.42.6(pid=20021): Launched 22:13:28.064276 run osmo-stp_10.42.42.5(pid=20018): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20018)] 22:13:28.193753 run osmo-stp_10.42.42.5(pid=20018): stdout: | (launched: 2022-12-08_22:13:26.881202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:28.322459 run osmo-stp_10.42.42.5(pid=20018): stderr: | 20221208221327052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221327052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221327052 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221327052 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221327053 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221327053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221327053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:28.449552 run osmo-stp_10.42.42.5(pid=20018): stdout: | (launched: 2022-12-08_22:13:26.881202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:28.570035 run osmo-stp_10.42.42.5(pid=20018): stderr: | 20221208221327052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221327052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221327052 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221327052 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221327053 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221327053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221327053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:28.714108 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20018): Process ended prematurely: osmo-stp_10.42.42.5(pid=20018) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20018)] [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:13:28.722949 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:13:28.749947 run osmo-hlr_10.42.42.2(pid=20015): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20015)] 22:13:28.798399 run osmo-hlr_10.42.42.2(pid=20015): stdout: | (launched: 2022-12-08_22:13:25.934203) 22:13:28.848780 run osmo-hlr_10.42.42.2(pid=20015): stderr: | 20221208221326107 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221326107 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221326107 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221326107 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221326107 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221326107 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221326119 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221326129 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221326130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221326130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:13:28.918993 run osmo-msc_10.42.42.6(pid=20021): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20021)] 22:13:28.967517 run osmo-msc_10.42.42.6(pid=20021): stdout: | (launched: 2022-12-08_22:13:27.840031) 22:13:29.017585 run osmo-msc_10.42.42.6(pid=20021): stderr: | 20221208221328109 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208221328110 DLGLOBAL DEBUG validating counter group 0x7f60cf820c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208221328110 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208221328110 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208221328110 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208221328110 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208221328112 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208221328112 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208221328112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208221328112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:13:29.067901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20014): Terminating (SIGTERM) 22:13:29.108044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20017): Terminating (SIGTERM) 22:13:29.148205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20020): Terminating (SIGTERM) 22:13:29.188479 --- ParallelTerminationStrategy: PID 20014 died... 22:13:29.207718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20014): Terminated: ok {rc=0} 22:13:29.252743 --- ParallelTerminationStrategy: PID 20017 died... 22:13:29.271420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20017): Terminated: ok {rc=0} 22:13:29.316121 --- ParallelTerminationStrategy: PID 20020 died... 22:13:29.334869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20020): Terminated: ok {rc=0} 22:13:29.421575 bus /sierra_3: Setting Powered False 22:13:30.521357 bus /sierra_3: Setting Powered False 22:13:31.642785 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:13:32.798933 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:32.810936 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:13:32.880752 tst mo_mt_call_osmux.py: using LAC 17098 22:13:33.001452 tst mo_mt_call_osmux.py: using RAC 13 22:13:33.128455 tst mo_mt_call_osmux.py: using CellId 17098 22:13:33.255381 tst mo_mt_call_osmux.py: using BVCI 17099 22:13:33.374490 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:33.386439 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:33.397980 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:33.410183 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:33.421864 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:33.433343 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:13:33.551870 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:13:33.667997 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:13:34.167488 run create_hlr_db(pid=20024): Launched 22:13:34.297997 bus /sierra_2: Setting Powered False 22:13:35.362520 run create_hlr_db(pid=20024): Terminated: ok {rc=0} 22:13:35.793696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20026): Launched 22:13:36.095495 run osmo-hlr_10.42.42.2(pid=20027): Launched 22:13:36.210656 run osmo-stp_10.42.42.5: Starting osmo-stp 22:13:36.743577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20029): Launched 22:13:37.044055 run osmo-stp_10.42.42.5(pid=20030): Launched 22:13:37.158745 run osmo-msc_10.42.42.6: Starting osmo-msc 22:13:37.704615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20032): Launched 22:13:38.006332 run osmo-msc_10.42.42.6(pid=20033): Launched 22:13:38.175659 run osmo-stp_10.42.42.5(pid=20030): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20030)] 22:13:38.304577 run osmo-stp_10.42.42.5(pid=20030): stdout: | (launched: 2022-12-08_22:13:36.989231) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:38.434209 run osmo-stp_10.42.42.5(pid=20030): stderr: | 20221208221337158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221337158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221337159 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221337159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221337160 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221337160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221337160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:38.560659 run osmo-stp_10.42.42.5(pid=20030): stdout: | (launched: 2022-12-08_22:13:36.989231) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:38.680860 run osmo-stp_10.42.42.5(pid=20030): stderr: | 20221208221337158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221337158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221337159 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221337159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221337160 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221337160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221337160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:38.825561 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20030): Process ended prematurely: osmo-stp_10.42.42.5(pid=20030) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20030)] [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:13:38.834380 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:13:38.861275 run osmo-hlr_10.42.42.2(pid=20027): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20027)] 22:13:38.909837 run osmo-hlr_10.42.42.2(pid=20027): stdout: | (launched: 2022-12-08_22:13:36.040902) 22:13:38.960125 run osmo-hlr_10.42.42.2(pid=20027): stderr: | 20221208221336216 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221336216 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221336216 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221336216 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221336216 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221336216 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221336229 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221336238 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221336238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221336238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:13:39.029953 run osmo-msc_10.42.42.6(pid=20033): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20033)] 22:13:39.078462 run osmo-msc_10.42.42.6(pid=20033): stdout: | (launched: 2022-12-08_22:13:37.951663) 22:13:39.128465 run osmo-msc_10.42.42.6(pid=20033): stderr: | 20221208221338219 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208221338219 DLGLOBAL DEBUG validating counter group 0x7f0592000c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208221338219 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208221338219 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208221338219 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208221338219 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208221338221 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208221338221 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208221338222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208221338222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:13:39.179102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20026): Terminating (SIGTERM) 22:13:39.219178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20029): Terminating (SIGTERM) 22:13:39.259349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20032): Terminating (SIGTERM) 22:13:39.300088 --- ParallelTerminationStrategy: PID 20026 died... 22:13:39.319684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20026): Terminated: ok {rc=0} 22:13:39.364627 --- ParallelTerminationStrategy: PID 20029 died... 22:13:39.383346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20029): Terminated: ok {rc=0} 22:13:39.428148 --- ParallelTerminationStrategy: PID 20032 died... 22:13:39.446923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20032): Terminated: ok {rc=0} 22:13:39.534422 bus /sierra_3: Setting Powered False 22:13:40.633907 bus /sierra_3: Setting Powered False 22:13:41.748349 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 22:13:42.995907 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:13:43.002608 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 22:13:43.035939 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 22:13:43.061926 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 22:13:43.114079 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 22:13:43.148190 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 22:13:43.174389 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 22:13:43.727132 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 22:13:43.776141 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:43.787227 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:13:43.856059 tst mo_mt_call.py: using LAC 17099 22:13:43.977218 tst mo_mt_call.py: using RAC 14 22:13:44.104309 tst mo_mt_call.py: using CellId 17099 22:13:44.231231 tst mo_mt_call.py: using BVCI 17100 22:13:44.348717 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:44.360401 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:44.371784 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:44.383157 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:44.394657 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:44.406035 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:13:44.519084 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:13:44.633802 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:13:45.101274 run create_hlr_db(pid=20038): Launched 22:13:45.217210 bus /sierra_2: Setting Powered False 22:13:46.279979 run create_hlr_db(pid=20038): Terminated: ok {rc=0} 22:13:46.745406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20040): Launched 22:13:47.093711 run osmo-hlr_10.42.42.2(pid=20041): Launched 22:13:47.215503 run osmo-stp_10.42.42.5: Starting osmo-stp 22:13:47.745483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20043): Launched 22:13:48.046966 run osmo-stp_10.42.42.5(pid=20044): Launched 22:13:48.161907 run osmo-msc_10.42.42.6: Starting osmo-msc 22:13:48.706923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20046): Launched 22:13:49.008382 run osmo-msc_10.42.42.6(pid=20047): Launched 22:13:49.177600 run osmo-stp_10.42.42.5(pid=20044): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20044)] 22:13:49.306501 run osmo-stp_10.42.42.5(pid=20044): stdout: | (launched: 2022-12-08_22:13:47.992465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:49.435528 run osmo-stp_10.42.42.5(pid=20044): stderr: | 20221208221348162 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221348162 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221348162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221348163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221348163 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221348163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221348163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:49.562382 run osmo-stp_10.42.42.5(pid=20044): stdout: | (launched: 2022-12-08_22:13:47.992465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:49.683012 run osmo-stp_10.42.42.5(pid=20044): stderr: | 20221208221348162 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221348162 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221348162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221348163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221348163 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221348163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221348163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:49.826959 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20044): Process ended prematurely: osmo-stp_10.42.42.5(pid=20044) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20044)] [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 22:13:49.835810 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:13:49.862611 run osmo-hlr_10.42.42.2(pid=20041): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20041)] 22:13:49.911113 run osmo-hlr_10.42.42.2(pid=20041): stdout: | (launched: 2022-12-08_22:13:47.025392) 22:13:49.961440 run osmo-hlr_10.42.42.2(pid=20041): stderr: | 20221208221347215 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221347215 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221347215 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221347215 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221347215 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221347216 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221347230 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221347240 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221347240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221347240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:13:50.031743 run osmo-msc_10.42.42.6(pid=20047): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20047)] 22:13:50.080253 run osmo-msc_10.42.42.6(pid=20047): stdout: | (launched: 2022-12-08_22:13:48.953916) 22:13:50.130418 run osmo-msc_10.42.42.6(pid=20047): stderr: | 20221208221349222 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208221349222 DLGLOBAL DEBUG validating counter group 0x7f3e33941c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208221349222 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208221349222 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208221349222 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208221349223 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208221349224 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208221349225 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208221349225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208221349225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:13:50.180802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20040): Terminating (SIGTERM) 22:13:50.221046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20043): Terminating (SIGTERM) 22:13:50.261539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20046): Terminating (SIGTERM) 22:13:50.302114 --- ParallelTerminationStrategy: PID 20040 died... 22:13:50.321251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20040): Terminated: ok {rc=0} 22:13:50.366306 --- ParallelTerminationStrategy: PID 20043 died... 22:13:50.384858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20043): Terminated: ok {rc=0} 22:13:50.429780 --- ParallelTerminationStrategy: PID 20046 died... 22:13:50.448427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20046): Terminated: ok {rc=0} 22:13:50.533508 bus /sierra_3: Setting Powered False 22:13:51.629329 bus /sierra_3: Setting Powered False 22:13:52.743188 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 22:13:53.893689 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:53.906037 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:13:53.999720 tst mo_mt_call_osmux.py: using LAC 17100 22:13:54.140175 tst mo_mt_call_osmux.py: using RAC 15 22:13:54.268151 tst mo_mt_call_osmux.py: using CellId 17100 22:13:54.396743 tst mo_mt_call_osmux.py: using BVCI 17101 22:13:54.507050 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:54.518312 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:54.529313 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:54.541352 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:54.552652 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:54.564399 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:13:54.685269 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:13:54.803136 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:13:55.303246 run create_hlr_db(pid=20049): Launched 22:13:55.435671 bus /sierra_2: Setting Powered False 22:13:56.500601 run create_hlr_db(pid=20049): Terminated: ok {rc=0} 22:13:56.933791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20051): Launched 22:13:57.235265 run osmo-hlr_10.42.42.2(pid=20052): Launched 22:13:57.350380 run osmo-stp_10.42.42.5: Starting osmo-stp 22:13:57.869622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20054): Launched 22:13:58.172056 run osmo-stp_10.42.42.5(pid=20055): Launched 22:13:58.286706 run osmo-msc_10.42.42.6: Starting osmo-msc 22:13:58.832554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20057): Launched 22:13:59.133779 run osmo-msc_10.42.42.6(pid=20058): Launched 22:13:59.302533 run osmo-stp_10.42.42.5(pid=20055): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20055)] 22:13:59.430930 run osmo-stp_10.42.42.5(pid=20055): stdout: | (launched: 2022-12-08_22:13:58.117164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:59.559234 run osmo-stp_10.42.42.5(pid=20055): stderr: | 20221208221358284 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221358284 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221358284 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221358285 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221358287 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221358287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221358287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:59.685588 run osmo-stp_10.42.42.5(pid=20055): stdout: | (launched: 2022-12-08_22:13:58.117164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:59.805613 run osmo-stp_10.42.42.5(pid=20055): stderr: | 20221208221358284 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221358284 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221358284 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221358285 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221358287 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221358287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221358287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:59.949792 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20055): Process ended prematurely: osmo-stp_10.42.42.5(pid=20055) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20055)] [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 22:13:59.958687 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:13:59.985879 run osmo-hlr_10.42.42.2(pid=20052): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20052)] 22:14:00.034798 run osmo-hlr_10.42.42.2(pid=20052): stdout: | (launched: 2022-12-08_22:13:57.180469) 22:14:00.085324 run osmo-hlr_10.42.42.2(pid=20052): stderr: | 20221208221357358 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221357358 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221357358 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221357358 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221357358 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221357358 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221357383 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221357392 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221357392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221357392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:14:00.155349 run osmo-msc_10.42.42.6(pid=20058): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20058)] 22:14:00.203992 run osmo-msc_10.42.42.6(pid=20058): stdout: | (launched: 2022-12-08_22:13:59.079323) 22:14:00.254308 run osmo-msc_10.42.42.6(pid=20058): stderr: | 20221208221359350 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208221359350 DLGLOBAL DEBUG validating counter group 0x7f238e54ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208221359350 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208221359350 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208221359350 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208221359351 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208221359352 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208221359353 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208221359353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208221359353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:14:00.305018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20051): Terminating (SIGTERM) 22:14:00.345510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20054): Terminating (SIGTERM) 22:14:00.386037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20057): Terminating (SIGTERM) 22:14:00.426653 --- ParallelTerminationStrategy: PID 20051 died... 22:14:00.445947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20051): Terminated: ok {rc=0} 22:14:00.490900 --- ParallelTerminationStrategy: PID 20054 died... 22:14:00.509718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20054): Terminated: ok {rc=0} 22:14:00.554530 --- ParallelTerminationStrategy: PID 20057 died... 22:14:00.573316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20057): Terminated: ok {rc=0} 22:14:00.659520 bus /sierra_3: Setting Powered False 22:14:01.761461 bus /sierra_3: Setting Powered False 22:14:02.882709 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:14:04.138564 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:14:04.145283 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:14:04.179836 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:14:04.206442 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:14:04.258356 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:14:04.292782 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:14:04.318832 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:14:04.867705 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:14:04.916331 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:04.927421 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:14:04.996410 tst mo_mt_call.py: using LAC 17101 22:14:05.115236 tst mo_mt_call.py: using RAC 16 22:14:05.235378 tst mo_mt_call.py: using CellId 17101 22:14:05.355065 tst mo_mt_call.py: using BVCI 17102 22:14:05.467193 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:05.478303 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:05.489226 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:05.500349 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:05.511546 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:05.522610 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:14:05.641899 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:14:05.760432 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:14:06.261370 run create_hlr_db(pid=20063): Launched 22:14:06.393363 bus /sierra_2: Setting Powered False 22:14:07.457695 run create_hlr_db(pid=20063): Terminated: ok {rc=0} 22:14:07.888252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20065): Launched 22:14:08.188928 run osmo-hlr_10.42.42.2(pid=20066): Launched 22:14:08.303588 run osmo-stp_10.42.42.5: Starting osmo-stp 22:14:08.834314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20068): Launched 22:14:09.135039 run osmo-stp_10.42.42.5(pid=20069): Launched 22:14:09.249882 run osmo-msc_10.42.42.6: Starting osmo-msc 22:14:09.798334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20071): Launched 22:14:10.101047 run osmo-msc_10.42.42.6(pid=20072): Launched 22:14:10.271092 run osmo-stp_10.42.42.5(pid=20069): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20069)] 22:14:10.400059 run osmo-stp_10.42.42.5(pid=20069): stdout: | (launched: 2022-12-08_22:14:09.080297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:10.529485 run osmo-stp_10.42.42.5(pid=20069): stderr: | 20221208221409251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221409251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221409251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221409251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221409252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221409252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221409252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:10.656335 run osmo-stp_10.42.42.5(pid=20069): stdout: | (launched: 2022-12-08_22:14:09.080297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:10.777827 run osmo-stp_10.42.42.5(pid=20069): stderr: | 20221208221409251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221409251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221409251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221409251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221409252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221409252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221409252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:10.922845 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20069): Process ended prematurely: osmo-stp_10.42.42.5(pid=20069) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20069)] [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:14:10.931579 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:14:10.958430 run osmo-hlr_10.42.42.2(pid=20066): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20066)] 22:14:11.007471 run osmo-hlr_10.42.42.2(pid=20066): stdout: | (launched: 2022-12-08_22:14:08.134558) 22:14:11.057779 run osmo-hlr_10.42.42.2(pid=20066): stderr: | 20221208221408309 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221408309 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221408309 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221408309 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221408309 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221408309 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221408333 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221408344 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221408344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221408344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:14:11.127847 run osmo-msc_10.42.42.6(pid=20072): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20072)] 22:14:11.176261 run osmo-msc_10.42.42.6(pid=20072): stdout: | (launched: 2022-12-08_22:14:10.045918) 22:14:11.226126 run osmo-msc_10.42.42.6(pid=20072): stderr: | 20221208221410317 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208221410317 DLGLOBAL DEBUG validating counter group 0x7f6d38e44c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208221410318 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208221410318 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208221410318 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208221410318 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208221410320 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208221410320 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208221410320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208221410320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:14:11.276481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20065): Terminating (SIGTERM) 22:14:11.316925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20068): Terminating (SIGTERM) 22:14:11.357711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20071): Terminating (SIGTERM) 22:14:11.398554 --- ParallelTerminationStrategy: PID 20065 died... 22:14:11.417790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20065): Terminated: ok {rc=0} 22:14:11.462781 --- ParallelTerminationStrategy: PID 20068 died... 22:14:11.481537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20068): Terminated: ok {rc=0} 22:14:11.526968 --- ParallelTerminationStrategy: PID 20071 died... 22:14:11.545665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20071): Terminated: ok {rc=0} 22:14:11.630070 bus /sierra_3: Setting Powered False 22:14:12.729093 bus /sierra_3: Setting Powered False 22:14:13.845948 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:14:14.995583 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:15.007917 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:14:15.080639 tst mo_mt_call_osmux.py: using LAC 17102 22:14:15.206800 tst mo_mt_call_osmux.py: using RAC 17 22:14:15.333970 tst mo_mt_call_osmux.py: using CellId 17102 22:14:15.463478 tst mo_mt_call_osmux.py: using BVCI 17103 22:14:15.582831 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:15.594603 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:15.606108 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:15.617544 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:15.629030 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:15.640396 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:14:15.755789 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:14:15.880082 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:14:16.403520 run create_hlr_db(pid=20074): Launched 22:14:16.570086 bus /sierra_2: Setting Powered False 22:14:17.634020 run create_hlr_db(pid=20074): Terminated: ok {rc=0} 22:14:18.082203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20076): Launched 22:14:18.403005 run osmo-hlr_10.42.42.2(pid=20077): Launched 22:14:18.524658 run osmo-stp_10.42.42.5: Starting osmo-stp 22:14:19.079075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20079): Launched 22:14:19.400633 run osmo-stp_10.42.42.5(pid=20080): Launched 22:14:19.523564 run osmo-msc_10.42.42.6: Starting osmo-msc 22:14:20.107788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20082): Launched 22:14:20.430324 run osmo-msc_10.42.42.6(pid=20083): Launched 22:14:20.609837 run osmo-stp_10.42.42.5(pid=20080): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20080)] 22:14:20.746358 run osmo-stp_10.42.42.5(pid=20080): stdout: | (launched: 2022-12-08_22:14:19.342624) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:20.883426 run osmo-stp_10.42.42.5(pid=20080): stderr: | 20221208221419535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221419535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221419535 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221419536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221419537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221419537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221419537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:21.019789 run osmo-stp_10.42.42.5(pid=20080): stdout: | (launched: 2022-12-08_22:14:19.342624) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:21.148578 run osmo-stp_10.42.42.5(pid=20080): stderr: | 20221208221419535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221419535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221419535 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221419536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221419537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221419537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221419537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:21.303232 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20080): Process ended prematurely: osmo-stp_10.42.42.5(pid=20080) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20080)] [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:14:21.312873 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 22:14:21.341178 run osmo-hlr_10.42.42.2(pid=20077): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20077)] 22:14:21.392102 run osmo-hlr_10.42.42.2(pid=20077): stdout: | (launched: 2022-12-08_22:14:18.345309) 22:14:21.444920 run osmo-hlr_10.42.42.2(pid=20077): stderr: | 20221208221418544 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221418544 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221418544 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221418544 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221418545 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221418545 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221418558 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221418566 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221418566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221418566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:14:21.518438 run osmo-msc_10.42.42.6(pid=20083): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20083)] 22:14:21.569253 run osmo-msc_10.42.42.6(pid=20083): stdout: | (launched: 2022-12-08_22:14:20.371879) 22:14:21.621790 run osmo-msc_10.42.42.6(pid=20083): stderr: | 20221208221420694 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208221420695 DLGLOBAL DEBUG validating counter group 0x7fc19625dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208221420695 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208221420695 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208221420695 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208221420695 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208221420697 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208221420697 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208221420697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208221420697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:14:21.674836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20076): Terminating (SIGTERM) 22:14:21.717066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20079): Terminating (SIGTERM) 22:14:21.759505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20082): Terminating (SIGTERM) 22:14:21.802132 --- ParallelTerminationStrategy: PID 20076 died... 22:14:21.822267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20076): Terminated: ok {rc=0} 22:14:21.869223 --- ParallelTerminationStrategy: PID 20079 died... 22:14:21.889039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20079): Terminated: ok {rc=0} 22:14:21.935737 --- ParallelTerminationStrategy: PID 20082 died... 22:14:21.955492 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20082): Terminated: ok {rc=0} 22:14:22.043279 bus /sierra_3: Setting Powered False 22:14:23.143068 bus /sierra_3: Setting Powered False 22:14:24.261559 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:14:25.514043 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:14:25.520639 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:14:25.557721 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:14:25.585072 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:14:25.638479 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:14:25.672937 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:14:25.700153 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:14:26.251836 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:14:26.303256 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:26.315204 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:14:26.385715 tst mo_mt_call.py: using LAC 17103 22:14:26.512818 tst mo_mt_call.py: using RAC 18 22:14:26.641248 tst mo_mt_call.py: using CellId 17103 22:14:26.767397 tst mo_mt_call.py: using BVCI 17104 22:14:26.886645 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:26.898498 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:26.910130 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:26.921714 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:26.933344 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:26.944875 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:14:27.059503 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:14:27.174151 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:14:27.641581 run create_hlr_db(pid=20088): Launched 22:14:27.758675 bus /sierra_2: Setting Powered False 22:14:28.819259 run create_hlr_db(pid=20088): Terminated: ok {rc=0} 22:14:29.259052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20090): Launched 22:14:29.581420 run osmo-hlr_10.42.42.2(pid=20091): Launched 22:14:29.707271 run osmo-stp_10.42.42.5: Starting osmo-stp 22:14:30.264908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20093): Launched 22:14:30.585532 run osmo-stp_10.42.42.5(pid=20094): Launched 22:14:30.708367 run osmo-msc_10.42.42.6: Starting osmo-msc 22:14:31.346215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20096): Launched 22:14:31.676256 run osmo-msc_10.42.42.6(pid=20097): Launched 22:14:31.910652 run osmo-stp_10.42.42.5(pid=20094): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20094)] 22:14:32.266481 run osmo-stp_10.42.42.5(pid=20094): stdout: | (launched: 2022-12-08_22:14:30.527753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:32.464353 run osmo-stp_10.42.42.5(pid=20094): stderr: | 20221208221430719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221430719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221430720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221430720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221430720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221430721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221430721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:32.599414 run osmo-stp_10.42.42.5(pid=20094): stdout: | (launched: 2022-12-08_22:14:30.527753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:32.728162 run osmo-stp_10.42.42.5(pid=20094): stderr: | 20221208221430719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221430719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221430720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221430720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221430720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221430721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221430721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:32.883470 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20094): Process ended prematurely: osmo-stp_10.42.42.5(pid=20094) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20094)] [trial-2350↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:14:32.893385 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 22:14:32.921560 run osmo-hlr_10.42.42.2(pid=20091): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20091)] 22:14:32.972855 run osmo-hlr_10.42.42.2(pid=20091): stdout: | (launched: 2022-12-08_22:14:29.523395) 22:14:33.025864 run osmo-hlr_10.42.42.2(pid=20091): stderr: | 20221208221429722 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221429722 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221429722 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221429722 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221429722 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221429722 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221429735 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221429744 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221429744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221429744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:14:33.099617 run osmo-msc_10.42.42.6(pid=20097): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20097)] 22:14:33.150799 run osmo-msc_10.42.42.6(pid=20097): stdout: | (launched: 2022-12-08_22:14:31.612206) 22:14:33.203724 run osmo-msc_10.42.42.6(pid=20097): stderr: | 20221208221432113 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208221432113 DLGLOBAL DEBUG validating counter group 0x7fcd7a782c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208221432113 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208221432113 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208221432114 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208221432114 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208221432115 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208221432116 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208221432116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208221432116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:14:33.257068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20090): Terminating (SIGTERM) 22:14:33.299577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20093): Terminating (SIGTERM) 22:14:33.342325 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20096): Terminating (SIGTERM) 22:14:33.385226 --- ParallelTerminationStrategy: PID 20090 died... 22:14:33.405634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20090): Terminated: ok {rc=0} 22:14:33.452744 --- ParallelTerminationStrategy: PID 20093 died... 22:14:33.472502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20093): Terminated: ok {rc=0} 22:14:33.519387 --- ParallelTerminationStrategy: PID 20096 died... 22:14:33.539337 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20096): Terminated: ok {rc=0} 22:14:33.627949 bus /sierra_3: Setting Powered False 22:14:34.726448 bus /sierra_3: Setting Powered False 22:14:35.844527 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:14:36.991198 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:37.003107 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:14:37.073921 tst mo_mt_call_osmux.py: using LAC 17104 22:14:37.194364 tst mo_mt_call_osmux.py: using RAC 19 22:14:37.315622 tst mo_mt_call_osmux.py: using CellId 17104 22:14:37.436329 tst mo_mt_call_osmux.py: using BVCI 17105 22:14:37.548301 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:37.559518 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:37.570439 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:37.581762 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:37.593040 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:37.604198 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:14:37.720329 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:14:37.834996 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:14:38.302608 run create_hlr_db(pid=20099): Launched 22:14:38.417274 bus /sierra_2: Setting Powered False 22:14:39.477517 run create_hlr_db(pid=20099): Terminated: ok {rc=0} 22:14:39.918450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20101): Launched 22:14:40.240918 run osmo-hlr_10.42.42.2(pid=20102): Launched 22:14:40.364287 run osmo-stp_10.42.42.5: Starting osmo-stp 22:14:40.924604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20104): Launched 22:14:41.245060 run osmo-stp_10.42.42.5(pid=20105): Launched 22:14:41.367471 run osmo-msc_10.42.42.6: Starting osmo-msc 22:14:41.948502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20107): Launched 22:14:42.269719 run osmo-msc_10.42.42.6(pid=20108): Launched 22:14:42.449178 run osmo-stp_10.42.42.5(pid=20105): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20105)] 22:14:42.585305 run osmo-stp_10.42.42.5(pid=20105): stdout: | (launched: 2022-12-08_22:14:41.187338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:42.722818 run osmo-stp_10.42.42.5(pid=20105): stderr: | 20221208221441378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221441378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221441378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221441379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221441381 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221441381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221441381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:42.859219 run osmo-stp_10.42.42.5(pid=20105): stdout: | (launched: 2022-12-08_22:14:41.187338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:42.988454 run osmo-stp_10.42.42.5(pid=20105): stderr: | 20221208221441378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221441378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221441378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221441379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221441381 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221441381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221441381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:43.143021 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20105): Process ended prematurely: osmo-stp_10.42.42.5(pid=20105) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20105)] [trial-2350↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:14:43.152648 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:14:43.180859 run osmo-hlr_10.42.42.2(pid=20102): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20102)] 22:14:43.231848 run osmo-hlr_10.42.42.2(pid=20102): stdout: | (launched: 2022-12-08_22:14:40.183038) 22:14:43.284480 run osmo-hlr_10.42.42.2(pid=20102): stderr: | 20221208221440382 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221440382 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221440382 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221440382 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221440382 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221440382 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221440395 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221440405 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221440405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221440405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:14:43.357635 run osmo-msc_10.42.42.6(pid=20108): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20108)] 22:14:43.408520 run osmo-msc_10.42.42.6(pid=20108): stdout: | (launched: 2022-12-08_22:14:42.211473) 22:14:43.461084 run osmo-msc_10.42.42.6(pid=20108): stderr: | 20221208221442533 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208221442533 DLGLOBAL DEBUG validating counter group 0x7f0bb15ebc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208221442533 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208221442533 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208221442533 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208221442534 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208221442535 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208221442536 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208221442536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208221442536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:14:43.513865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20101): Terminating (SIGTERM) 22:14:43.556041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20104): Terminating (SIGTERM) 22:14:43.598273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20107): Terminating (SIGTERM) 22:14:43.640757 --- ParallelTerminationStrategy: PID 20101 died... 22:14:43.660906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20101): Terminated: ok {rc=0} 22:14:43.707864 --- ParallelTerminationStrategy: PID 20104 died... 22:14:43.727661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20104): Terminated: ok {rc=0} 22:14:43.774552 --- ParallelTerminationStrategy: PID 20107 died... 22:14:43.794358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20107): Terminated: ok {rc=0} 22:14:43.882342 bus /sierra_3: Setting Powered False 22:14:44.982042 bus /sierra_3: Setting Powered False 22:14:46.103203 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:14:47.375300 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:14:47.381385 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:14:47.415564 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 22:14:47.442718 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 22:14:47.495687 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:14:47.530001 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 22:14:47.557236 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 22:14:48.108704 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 22:14:48.159839 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:14:48.171221 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:14:48.243337 tst mo_mt_call.py: using LAC 17105 22:14:48.369008 tst mo_mt_call.py: using RAC 20 22:14:48.500087 tst mo_mt_call.py: using CellId 17105 22:14:48.626680 tst mo_mt_call.py: using BVCI 17106 22:14:48.743228 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:14:48.754687 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:14:48.765917 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:14:48.777218 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:14:48.788541 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:14:48.799808 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:14:48.917885 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:14:49.038116 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:14:49.536026 run create_hlr_db(pid=20113): Launched 22:14:49.666004 bus /sierra_2: Setting Powered False 22:14:50.729803 run create_hlr_db(pid=20113): Terminated: ok {rc=0} 22:14:51.161707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20115): Launched 22:14:51.464782 run osmo-hlr_10.42.42.2(pid=20116): Launched 22:14:51.582237 run osmo-stp_10.42.42.5: Starting osmo-stp 22:14:52.113844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20118): Launched 22:14:52.414745 run osmo-stp_10.42.42.5(pid=20119): Launched 22:14:52.530649 run osmo-msc_10.42.42.6: Starting osmo-msc 22:14:53.076677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20121): Launched 22:14:53.379455 run osmo-msc_10.42.42.6(pid=20122): Launched 22:14:53.548532 run osmo-stp_10.42.42.5(pid=20119): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20119)] 22:14:53.678639 run osmo-stp_10.42.42.5(pid=20119): stdout: | (launched: 2022-12-08_22:14:52.360224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:53.807749 run osmo-stp_10.42.42.5(pid=20119): stderr: | 20221208221452529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221452529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221452529 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221452530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221452530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221452530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221452530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:53.934715 run osmo-stp_10.42.42.5(pid=20119): stdout: | (launched: 2022-12-08_22:14:52.360224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:54.055513 run osmo-stp_10.42.42.5(pid=20119): stderr: | 20221208221452529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221452529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221452529 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221452530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221452530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221452530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221452530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:54.200237 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20119): Process ended prematurely: osmo-stp_10.42.42.5(pid=20119) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20119)] [trial-2350↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 22:14:54.209487 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:14:54.236831 run osmo-hlr_10.42.42.2(pid=20116): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20116)] 22:14:54.286098 run osmo-hlr_10.42.42.2(pid=20116): stdout: | (launched: 2022-12-08_22:14:51.409940) 22:14:54.337088 run osmo-hlr_10.42.42.2(pid=20116): stderr: | 20221208221451587 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221451587 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221451587 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221451588 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221451588 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221451588 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221451600 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221451609 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221451609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221451609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:14:54.407489 run osmo-msc_10.42.42.6(pid=20122): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20122)] 22:14:54.456422 run osmo-msc_10.42.42.6(pid=20122): stdout: | (launched: 2022-12-08_22:14:53.324715) 22:14:54.506855 run osmo-msc_10.42.42.6(pid=20122): stderr: | 20221208221453596 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208221453596 DLGLOBAL DEBUG validating counter group 0x7f77ec43ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208221453596 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208221453597 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208221453597 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208221453597 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208221453599 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208221453599 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208221453599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208221453599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:14:54.557967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20115): Terminating (SIGTERM) 22:14:54.598554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20118): Terminating (SIGTERM) 22:14:54.638978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20121): Terminating (SIGTERM) 22:14:54.679853 --- ParallelTerminationStrategy: PID 20115 died... 22:14:54.699081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20115): Terminated: ok {rc=0} 22:14:54.744644 --- ParallelTerminationStrategy: PID 20118 died... 22:14:54.763487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20118): Terminated: ok {rc=0} 22:14:54.808366 --- ParallelTerminationStrategy: PID 20121 died... 22:14:54.827381 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20121): Terminated: ok {rc=0} 22:14:54.912346 bus /sierra_3: Setting Powered False 22:14:56.010358 bus /sierra_3: Setting Powered False 22:14:57.123842 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 22:14:58.273623 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:14:58.285695 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:14:58.358775 tst mo_mt_call_osmux.py: using LAC 17106 22:14:58.486966 tst mo_mt_call_osmux.py: using RAC 21 22:14:58.614512 tst mo_mt_call_osmux.py: using CellId 17106 22:14:58.744673 tst mo_mt_call_osmux.py: using BVCI 17107 22:14:58.864185 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:14:58.875675 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:14:58.887034 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:14:58.898324 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:14:58.909712 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:14:58.920928 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:14:59.039675 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:14:59.162874 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:14:59.659639 run create_hlr_db(pid=20125): Launched 22:14:59.790221 bus /sierra_2: Setting Powered False 22:15:00.858716 run create_hlr_db(pid=20125): Terminated: ok {rc=0} 22:15:01.334583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20127): Launched 22:15:01.668628 run osmo-hlr_10.42.42.2(pid=20128): Launched 22:15:01.893782 run osmo-stp_10.42.42.5: Starting osmo-stp 22:15:02.559648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20133): Launched 22:15:02.861535 run osmo-stp_10.42.42.5(pid=20134): Launched 22:15:02.978051 run osmo-msc_10.42.42.6: Starting osmo-msc 22:15:03.526142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20136): Launched 22:15:03.826709 run osmo-msc_10.42.42.6(pid=20137): Launched 22:15:03.994812 run osmo-stp_10.42.42.5(pid=20134): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20134)] 22:15:04.124205 run osmo-stp_10.42.42.5(pid=20134): stdout: | (launched: 2022-12-08_22:15:02.806869) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:04.253282 run osmo-stp_10.42.42.5(pid=20134): stderr: | 20221208221502978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221502978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221502978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221502979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221502979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221502979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221502979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:04.380086 run osmo-stp_10.42.42.5(pid=20134): stdout: | (launched: 2022-12-08_22:15:02.806869) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:04.500653 run osmo-stp_10.42.42.5(pid=20134): stderr: | 20221208221502978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221502978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221502978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221502979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221502979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221502979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221502979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:04.644641 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20134): Process ended prematurely: osmo-stp_10.42.42.5(pid=20134) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20134)] [trial-2350↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 22:15:04.653599 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 22:15:04.680721 run osmo-hlr_10.42.42.2(pid=20128): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20128)] 22:15:04.729513 run osmo-hlr_10.42.42.2(pid=20128): stdout: | (launched: 2022-12-08_22:15:01.607037) 22:15:04.780211 run osmo-hlr_10.42.42.2(pid=20128): stderr: | 20221208221501922 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221501923 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221501923 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221501923 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221501923 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221501923 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221501948 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221501960 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221501965 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221501965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:15:04.850254 run osmo-msc_10.42.42.6(pid=20137): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20137)] 22:15:04.898695 run osmo-msc_10.42.42.6(pid=20137): stdout: | (launched: 2022-12-08_22:15:03.772379) 22:15:04.948776 run osmo-msc_10.42.42.6(pid=20137): stderr: | 20221208221504042 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208221504042 DLGLOBAL DEBUG validating counter group 0x7f1bfdadbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208221504043 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208221504043 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208221504043 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208221504043 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208221504045 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208221504046 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208221504046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208221504046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:15:04.999156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20127): Terminating (SIGTERM) 22:15:05.039534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20133): Terminating (SIGTERM) 22:15:05.079874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20136): Terminating (SIGTERM) 22:15:05.121136 --- ParallelTerminationStrategy: PID 20127 died... 22:15:05.140296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20127): Terminated: ok {rc=0} 22:15:05.185761 --- ParallelTerminationStrategy: PID 20133 died... 22:15:05.204734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20133): Terminated: ok {rc=0} 22:15:05.249533 --- ParallelTerminationStrategy: PID 20136 died... 22:15:05.268233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20136): Terminated: ok {rc=0} 22:15:05.355140 bus /sierra_3: Setting Powered False 22:15:06.455417 bus /sierra_3: Setting Powered False 22:15:07.571543 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 22:15:08.819251 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:15:08.825294 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 22:15:08.860352 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 22:15:08.887502 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 22:15:08.974401 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 22:15:09.008528 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 22:15:09.035495 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 22:15:09.621133 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2350 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 22:15:09.627170 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:09.639812 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:15:09.691873 tst emergency_mo_mt_call.py: using LAC 17107 22:15:09.810802 tst emergency_mo_mt_call.py: using RAC 22 22:15:09.927547 tst emergency_mo_mt_call.py: using CellId 17107 22:15:10.053481 tst emergency_mo_mt_call.py: using BVCI 17108 22:15:10.169358 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:10.180521 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:10.191489 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:10.202402 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:10.213607 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:10.224556 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:10.337588 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:10.451070 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:15:10.910322 run create_hlr_db(pid=20143): Launched 22:15:11.024429 bus /sierra_2: Setting Powered False 22:15:12.084081 run create_hlr_db(pid=20143): Terminated: ok {rc=0} 22:15:12.498648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20145): Launched 22:15:12.793726 run osmo-hlr_10.42.42.2(pid=20146): Launched 22:15:12.906845 run osmo-stp_10.42.42.5: Starting osmo-stp 22:15:13.417674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20148): Launched 22:15:13.713703 run osmo-stp_10.42.42.5(pid=20149): Launched 22:15:13.835896 tst emergency_mo_mt_call.py: using MSISDN 6878 22:15:14.002085 run osmo-msc_10.42.42.6: Starting osmo-msc 22:15:14.533296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20151): Launched 22:15:14.827464 run osmo-msc_10.42.42.6(pid=20152): Launched 22:15:14.994051 run osmo-stp_10.42.42.5(pid=20149): ERR: Terminated: ERROR {rc=1} [trial-2350↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20149)] 22:15:15.120684 run osmo-stp_10.42.42.5(pid=20149): stdout: | (launched: 2022-12-08_22:15:13.659903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:15.247791 run osmo-stp_10.42.42.5(pid=20149): stderr: | 20221208221513830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221513830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221513830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221513831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221513831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221513831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221513831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:15.372334 run osmo-stp_10.42.42.5(pid=20149): stdout: | (launched: 2022-12-08_22:15:13.659903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:15.490328 run osmo-stp_10.42.42.5(pid=20149): stderr: | 20221208221513830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221513830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221513830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221513831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221513831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221513831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221513831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:15.631317 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=20149): Process ended prematurely: osmo-stp_10.42.42.5(pid=20149) [trial-2350↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20149)] [trial-2350↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 22:15:15.639735 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 22:15:15.666201 run osmo-hlr_10.42.42.2(pid=20146): ERR: Terminated: ERROR {rc=237} [trial-2350↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20146)] 22:15:15.715247 run osmo-hlr_10.42.42.2(pid=20146): stdout: | (launched: 2022-12-08_22:15:12.740147) 22:15:15.765473 run osmo-hlr_10.42.42.2(pid=20146): stderr: | 20221208221512914 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221512914 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221512915 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221512915 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221512915 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221512915 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221512927 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221512935 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221512935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221512935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:15:15.841030 run osmo-msc_10.42.42.6(pid=20152): ERR: Terminated: ERROR {rc=2} [trial-2350↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20152)] 22:15:15.891578 run osmo-msc_10.42.42.6(pid=20152): stdout: | (launched: 2022-12-08_22:15:14.774149) 22:15:15.943429 run osmo-msc_10.42.42.6(pid=20152): stderr: | 20221208221515044 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208221515044 DLGLOBAL DEBUG validating counter group 0x7ff740947c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208221515044 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208221515044 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208221515044 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208221515045 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208221515046 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208221515047 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208221515047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208221515047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:15:15.995917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20145): Terminating (SIGTERM) 22:15:16.038203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20148): Terminating (SIGTERM) 22:15:16.080731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20151): Terminating (SIGTERM) 22:15:16.125613 --- ParallelTerminationStrategy: PID 20145 died... 22:15:16.145402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20145): Terminated: ok {rc=0} 22:15:16.194302 --- ParallelTerminationStrategy: PID 20148 died... 22:15:16.214289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20148): Terminated: ok {rc=0} 22:15:16.261578 --- ParallelTerminationStrategy: PID 20151 died... 22:15:16.281403 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20151): Terminated: ok {rc=0} 22:15:16.370474 bus /sierra_3: Setting Powered False 22:15:17.471272 bus /sierra_3: Setting Powered False 22:15:18.587715 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 22:15:19.674823 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:19.686740 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:15:19.739822 tst emergency_preemptive_call.py: using LAC 17108 22:15:19.857660 tst emergency_preemptive_call.py: using RAC 23 22:15:19.975573 tst emergency_preemptive_call.py: using CellId 17108 22:15:20.093281 tst emergency_preemptive_call.py: using BVCI 17109 22:15:20.201786 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:20.212656 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:20.223254 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:20.233778 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:20.244886 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:20.255677 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:20.372040 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:20.487844 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:20.603211 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:20.716881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:15:21.208215 run create_hlr_db(pid=20154): Launched 22:15:21.337066 bus /sierra_2: Setting Powered False 22:15:22.396575 run create_hlr_db(pid=20154): Terminated: ok {rc=0} 22:15:22.835603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20156): Launched 22:15:23.151035 run osmo-hlr_10.42.42.2(pid=20157): Launched 22:15:23.270947 run osmo-stp_10.42.42.5: Starting osmo-stp 22:15:23.813587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20159): Launched 22:15:24.130218 run osmo-stp_10.42.42.5(pid=20160): Launched 22:15:24.259603 tst emergency_preemptive_call.py: using MSISDN 6879 22:15:24.420177 run osmo-msc_10.42.42.6: Starting osmo-msc 22:15:24.986328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20162): Launched 22:15:25.301629 run osmo-msc_10.42.42.6(pid=20163): Launched 22:15:25.478453 run osmo-stp_10.42.42.5(pid=20160): ERR: Terminated: ERROR {rc=1} [trial-2350↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20160)] 22:15:25.612598 run osmo-stp_10.42.42.5(pid=20160): stdout: | (launched: 2022-12-08_22:15:24.073109) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:25.747735 run osmo-stp_10.42.42.5(pid=20160): stderr: | 20221208221524267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221524267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221524267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221524268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221524268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221524268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221524268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:25.882734 run osmo-stp_10.42.42.5(pid=20160): stdout: | (launched: 2022-12-08_22:15:24.073109) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:26.009371 run osmo-stp_10.42.42.5(pid=20160): stderr: | 20221208221524267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221524267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221524267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221524268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221524268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221524268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221524268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:26.160409 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=20160): Process ended prematurely: osmo-stp_10.42.42.5(pid=20160) [trial-2350↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20160)] [trial-2350↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 22:15:26.169464 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 22:15:26.197047 run osmo-hlr_10.42.42.2(pid=20157): ERR: Terminated: ERROR {rc=237} [trial-2350↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20157)] 22:15:26.247742 run osmo-hlr_10.42.42.2(pid=20157): stdout: | (launched: 2022-12-08_22:15:23.094315) 22:15:26.300235 run osmo-hlr_10.42.42.2(pid=20157): stderr: | 20221208221523290 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221523290 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221523290 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221523290 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221523290 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221523290 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221523303 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221523313 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221523313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221523314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:15:26.373804 run osmo-msc_10.42.42.6(pid=20163): ERR: Terminated: ERROR {rc=2} [trial-2350↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20163)] 22:15:26.424634 run osmo-msc_10.42.42.6(pid=20163): stdout: | (launched: 2022-12-08_22:15:25.244045) 22:15:26.477122 run osmo-msc_10.42.42.6(pid=20163): stderr: | 20221208221525567 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208221525567 DLGLOBAL DEBUG validating counter group 0x7effd9c7fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208221525567 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208221525567 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208221525567 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208221525568 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208221525569 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208221525570 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208221525570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208221525570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:15:26.529528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20156): Terminating (SIGTERM) 22:15:26.571611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20159): Terminating (SIGTERM) 22:15:26.613867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20162): Terminating (SIGTERM) 22:15:26.656254 --- ParallelTerminationStrategy: PID 20156 died... 22:15:26.676451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20156): Terminated: ok {rc=0} 22:15:26.723083 --- ParallelTerminationStrategy: PID 20159 died... 22:15:26.742710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20159): Terminated: ok {rc=0} 22:15:26.789223 --- ParallelTerminationStrategy: PID 20162 died... 22:15:26.808703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20162): Terminated: ok {rc=0} 22:15:26.896999 bus /sierra_9: Setting Powered False 22:15:27.996345 bus /sierra_9: Setting Powered False 22:15:29.112672 bus /sierra_8: Setting Powered False 22:15:30.211231 bus /sierra_8: Setting Powered False 22:15:31.340552 bus /sierra_3: Setting Powered False 22:15:32.455346 bus /sierra_3: Setting Powered False 22:15:33.572278 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 22:15:34.860061 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:15:34.864752 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 22:15:34.898492 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 22:15:34.937534 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 22:15:35.024808 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 22:15:35.058780 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 22:15:35.097454 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 22:15:35.686227 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 22:15:35.737687 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:35.748412 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:15:35.802654 tst cs_paging_gprs_active.py: using LAC 17109 22:15:35.921819 tst cs_paging_gprs_active.py: using RAC 24 22:15:36.040929 tst cs_paging_gprs_active.py: using CellId 17109 22:15:36.158010 tst cs_paging_gprs_active.py: using BVCI 17110 22:15:36.268312 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:36.278992 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:36.289468 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:36.300202 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:36.310853 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:36.321831 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:36.332593 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:36.343170 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:36.354226 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:36.469658 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:36.590186 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:15:36.809068 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:15:37.133405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20168): Launched 22:15:37.416327 run iperf3-srv_10.42.42.10(pid=20169): Launched 22:15:37.538454 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:15:37.756917 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:15:38.082966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20170): Launched 22:15:38.363409 run iperf3-srv_10.42.42.10(pid=20171): Launched 22:15:38.485289 tst cs_paging_gprs_active.py:38: start network... 22:15:38.702988 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:15:39.204736 run create_hlr_db(pid=20172): Launched 22:15:39.337913 bus /sierra_2: Setting Powered False 22:15:40.401948 run create_hlr_db(pid=20172): Terminated: ok {rc=0} 22:15:40.850905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20174): Launched 22:15:41.174845 run osmo-hlr_10.42.42.2(pid=20175): Launched 22:15:41.297611 run osmo-stp_10.42.42.5: Starting osmo-stp 22:15:41.853172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20177): Launched 22:15:42.175648 run osmo-stp_10.42.42.5(pid=20178): Launched 22:15:42.298404 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:15:42.854978 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20180): Launched 22:15:42.978816 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:15:43.251670 run patchelf(pid=20181): Launched 22:15:43.431517 run osmo-stp_10.42.42.5(pid=20178): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20178)] 22:15:43.568804 run osmo-stp_10.42.42.5(pid=20178): stdout: | (launched: 2022-12-08_22:15:42.117665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:43.707482 run osmo-stp_10.42.42.5(pid=20178): stderr: | 20221208221542309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221542309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221542309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221542310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221542310 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221542310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221542310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:43.846049 run osmo-stp_10.42.42.5(pid=20178): stdout: | (launched: 2022-12-08_22:15:42.117665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:43.980211 run osmo-stp_10.42.42.5(pid=20178): stderr: | 20221208221542309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221542309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221542309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221542310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221542310 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221542310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221542310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:44.138235 run patchelf(pid=20181): Terminating (SIGINT) 22:15:44.319562 run patchelf(pid=20181): Terminated: ok {rc=0} 22:15:44.450671 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20178): Process ended prematurely: osmo-stp_10.42.42.5(pid=20178) [trial-2350↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20178)] [trial-2350↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 22:15:44.460877 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 22:15:44.489788 run osmo-hlr_10.42.42.2(pid=20175): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20175)] 22:15:44.540454 run osmo-hlr_10.42.42.2(pid=20175): stdout: | (launched: 2022-12-08_22:15:41.116751) 22:15:44.592875 run osmo-hlr_10.42.42.2(pid=20175): stderr: | 20221208221541315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221541315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221541315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221541315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221541315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221541315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221541327 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221541335 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221541335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221541335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:15:44.645691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20168): Terminating (SIGTERM) 22:15:44.687884 run iperf3-srv_10.42.42.10(pid=20169): Terminating (SIGTERM) 22:15:44.730029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20170): Terminating (SIGTERM) 22:15:44.772335 run iperf3-srv_10.42.42.10(pid=20171): Terminating (SIGTERM) 22:15:44.814466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20174): Terminating (SIGTERM) 22:15:44.857061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20177): Terminating (SIGTERM) 22:15:44.899299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20180): Terminating (SIGTERM) 22:15:44.941960 --- ParallelTerminationStrategy: PID 20168 died... 22:15:44.962039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20168): Terminated: ok {rc=0} 22:15:45.008781 --- ParallelTerminationStrategy: PID 20169 died... 22:15:45.028383 run iperf3-srv_10.42.42.10(pid=20169): Terminated {rc=256} 22:15:45.074757 --- ParallelTerminationStrategy: PID 20170 died... 22:15:45.094438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20170): Terminated: ok {rc=0} 22:15:45.140724 --- ParallelTerminationStrategy: PID 20171 died... 22:15:45.160327 run iperf3-srv_10.42.42.10(pid=20171): Terminated {rc=256} 22:15:45.206579 --- ParallelTerminationStrategy: PID 20174 died... 22:15:45.226073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20174): Terminated: ok {rc=0} 22:15:45.272308 --- ParallelTerminationStrategy: PID 20177 died... 22:15:45.291923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20177): Terminated: ok {rc=0} 22:15:45.338431 --- ParallelTerminationStrategy: PID 20180 died... 22:15:45.358161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20180): Terminated: ok {rc=0} 22:15:45.447829 bus /gobi_0: Setting Powered False 22:15:46.546032 bus /gobi_0: Setting Powered False 22:15:47.660139 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 22:15:48.809612 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:48.821254 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:15:48.874732 tst iperf3.py: using LAC 17110 22:15:49.002389 tst iperf3.py: using RAC 25 22:15:49.130864 tst iperf3.py: using CellId 17110 22:15:49.259369 tst iperf3.py: using BVCI 17111 22:15:49.378182 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:49.389370 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:49.400257 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:49.411265 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:49.422223 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:49.433106 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:49.444147 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:49.455257 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:49.466482 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:49.583925 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:15:49.801586 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:15:50.124698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20182): Launched 22:15:50.404003 run iperf3-srv_10.42.42.10(pid=20183): Launched 22:15:50.524654 tst iperf3.py:8: start network... 22:15:50.741907 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:15:51.241966 run create_hlr_db(pid=20184): Launched 22:15:51.371741 bus /gobi_6: Setting Powered False 22:15:52.436363 run create_hlr_db(pid=20184): Terminated: ok {rc=0} 22:15:52.868388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20186): Launched 22:15:53.171200 run osmo-hlr_10.42.42.2(pid=20187): Launched 22:15:53.286364 run osmo-stp_10.42.42.5: Starting osmo-stp 22:15:53.825192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20189): Launched 22:15:54.127947 run osmo-stp_10.42.42.5(pid=20190): Launched 22:15:54.243836 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:15:54.770316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20192): Launched 22:15:54.886145 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:15:55.142223 run patchelf(pid=20193): Launched 22:15:55.310502 run osmo-stp_10.42.42.5(pid=20190): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20190)] 22:15:55.439279 run osmo-stp_10.42.42.5(pid=20190): stdout: | (launched: 2022-12-08_22:15:54.073233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:55.570380 run osmo-stp_10.42.42.5(pid=20190): stderr: | 20221208221554243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221554243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221554244 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221554244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221554245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221554245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221554245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:55.700938 run osmo-stp_10.42.42.5(pid=20190): stdout: | (launched: 2022-12-08_22:15:54.073233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:55.826526 run osmo-stp_10.42.42.5(pid=20190): stderr: | 20221208221554243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221554243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221554244 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221554244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221554245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221554245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221554245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:55.974852 run patchelf(pid=20193): Terminating (SIGINT) 22:15:56.145939 run patchelf(pid=20193): Terminated: ok {rc=0} 22:15:56.268934 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20190): Process ended prematurely: osmo-stp_10.42.42.5(pid=20190) [trial-2350↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20190)] [trial-2350↪gprs:trx-sysmocell5000↪iperf3.py:8] 22:15:56.278597 tst iperf3.py:8: Test FAILED (7.5 sec) 22:15:56.306157 run osmo-hlr_10.42.42.2(pid=20187): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20187)] 22:15:56.355166 run osmo-hlr_10.42.42.2(pid=20187): stdout: | (launched: 2022-12-08_22:15:53.116525) 22:15:56.405551 run osmo-hlr_10.42.42.2(pid=20187): stderr: | 20221208221553290 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221553290 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221553290 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221553290 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221553290 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221553290 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221553302 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221553311 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221553311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221553311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:15:56.456346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20182): Terminating (SIGTERM) 22:15:56.497629 run iperf3-srv_10.42.42.10(pid=20183): Terminating (SIGTERM) 22:15:56.538196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20186): Terminating (SIGTERM) 22:15:56.578846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20189): Terminating (SIGTERM) 22:15:56.619552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20192): Terminating (SIGTERM) 22:15:56.660366 --- ParallelTerminationStrategy: PID 20182 died... 22:15:56.679719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20182): Terminated: ok {rc=0} 22:15:56.724917 --- ParallelTerminationStrategy: PID 20183 died... 22:15:56.743705 run iperf3-srv_10.42.42.10(pid=20183): Terminated {rc=256} 22:15:56.788771 --- ParallelTerminationStrategy: PID 20186 died... 22:15:56.807580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20186): Terminated: ok {rc=0} 22:15:56.852625 --- ParallelTerminationStrategy: PID 20189 died... 22:15:56.871430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20189): Terminated: ok {rc=0} 22:15:56.916363 --- ParallelTerminationStrategy: PID 20192 died... 22:15:56.935115 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20192): Terminated: ok {rc=0} 22:15:57.021093 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 22:15:58.163983 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:58.175238 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:15:58.225066 tst iperf3m4.py: using LAC 17111 22:15:58.345042 tst iperf3m4.py: using RAC 26 22:15:58.462587 tst iperf3m4.py: using CellId 17111 22:15:58.583850 tst iperf3m4.py: using BVCI 17112 22:15:58.695504 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:58.706296 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:58.716728 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:58.727484 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:58.738205 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:58.748726 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:58.759510 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:58.770173 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:58.780903 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:58.900763 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:59.018102 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:59.136452 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:59.250611 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:15:59.452832 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:15:59.755343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20194): Launched 22:16:00.017669 run iperf3-srv_10.42.42.10(pid=20195): Launched 22:16:00.131319 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:16:00.334197 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:16:00.637377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20196): Launched 22:16:00.913837 run iperf3-srv_10.42.42.10(pid=20197): Launched 22:16:01.055218 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:16:01.277053 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:16:01.612192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20198): Launched 22:16:01.907798 run iperf3-srv_10.42.42.10(pid=20199): Launched 22:16:02.039863 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:16:02.262328 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:16:02.588247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20200): Launched 22:16:02.868473 run iperf3-srv_10.42.42.10(pid=20201): Launched 22:16:02.990035 tst iperf3m4.py:8: start network... 22:16:03.208089 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:16:03.710839 run create_hlr_db(pid=20202): Launched 22:16:03.841480 bus /gobi_6: Setting Powered False 22:16:04.906297 run create_hlr_db(pid=20202): Terminated: ok {rc=0} 22:16:05.338513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20204): Launched 22:16:05.640847 run osmo-hlr_10.42.42.2(pid=20205): Launched 22:16:05.755921 run osmo-stp_10.42.42.5: Starting osmo-stp 22:16:06.290999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20207): Launched 22:16:06.593050 run osmo-stp_10.42.42.5(pid=20208): Launched 22:16:06.707951 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:16:07.229773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20210): Launched 22:16:07.345727 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:16:07.601975 run patchelf(pid=20211): Launched 22:16:07.771084 run osmo-stp_10.42.42.5(pid=20208): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20208)] 22:16:07.900105 run osmo-stp_10.42.42.5(pid=20208): stdout: | (launched: 2022-12-08_22:16:06.538169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:08.030197 run osmo-stp_10.42.42.5(pid=20208): stderr: | 20221208221606710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221606710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221606710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221606711 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221606711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221606711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221606711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:08.160698 run osmo-stp_10.42.42.5(pid=20208): stdout: | (launched: 2022-12-08_22:16:06.538169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:08.285825 run osmo-stp_10.42.42.5(pid=20208): stderr: | 20221208221606710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221606710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221606710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221606711 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221606711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221606711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221606711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:08.433587 run patchelf(pid=20211): Terminating (SIGINT) 22:16:08.604154 run patchelf(pid=20211): Terminated: ok {rc=0} 22:16:08.727065 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20208): Process ended prematurely: osmo-stp_10.42.42.5(pid=20208) [trial-2350↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20208)] [trial-2350↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 22:16:08.736439 tst iperf3m4.py:8: Test FAILED (10.6 sec) 22:16:08.766168 run osmo-hlr_10.42.42.2(pid=20205): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20205)] 22:16:08.815304 run osmo-hlr_10.42.42.2(pid=20205): stdout: | (launched: 2022-12-08_22:16:05.585803) 22:16:08.865789 run osmo-hlr_10.42.42.2(pid=20205): stderr: | 20221208221605762 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221605762 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221605762 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221605762 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221605762 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221605762 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221605775 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221605785 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221605786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221605786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:16:08.917125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20194): Terminating (SIGTERM) 22:16:08.957944 run iperf3-srv_10.42.42.10(pid=20195): Terminating (SIGTERM) 22:16:08.998700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20196): Terminating (SIGTERM) 22:16:09.039566 run iperf3-srv_10.42.42.10(pid=20197): Terminating (SIGTERM) 22:16:09.080071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20198): Terminating (SIGTERM) 22:16:09.120799 run iperf3-srv_10.42.42.10(pid=20199): Terminating (SIGTERM) 22:16:09.161502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20200): Terminating (SIGTERM) 22:16:09.202222 run iperf3-srv_10.42.42.10(pid=20201): Terminating (SIGTERM) 22:16:09.242791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20204): Terminating (SIGTERM) 22:16:09.283243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20207): Terminating (SIGTERM) 22:16:09.323810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20210): Terminating (SIGTERM) 22:16:09.364832 --- ParallelTerminationStrategy: PID 20194 died... 22:16:09.384292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20194): Terminated: ok {rc=0} 22:16:09.429896 --- ParallelTerminationStrategy: PID 20195 died... 22:16:09.448754 run iperf3-srv_10.42.42.10(pid=20195): Terminated {rc=256} 22:16:09.493778 --- ParallelTerminationStrategy: PID 20196 died... 22:16:09.512622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20196): Terminated: ok {rc=0} 22:16:09.558500 --- ParallelTerminationStrategy: PID 20197 died... 22:16:09.577322 run iperf3-srv_10.42.42.10(pid=20197): Terminated {rc=256} 22:16:09.622744 --- ParallelTerminationStrategy: PID 20198 died... 22:16:09.641701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20198): Terminated: ok {rc=0} 22:16:09.687218 --- ParallelTerminationStrategy: PID 20199 died... 22:16:09.706256 run iperf3-srv_10.42.42.10(pid=20199): Terminated {rc=256} 22:16:09.751745 --- ParallelTerminationStrategy: PID 20200 died... 22:16:09.770537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20200): Terminated: ok {rc=0} 22:16:09.815713 --- ParallelTerminationStrategy: PID 20201 died... 22:16:09.834573 run iperf3-srv_10.42.42.10(pid=20201): Terminated {rc=256} 22:16:09.879591 --- ParallelTerminationStrategy: PID 20204 died... 22:16:09.898299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20204): Terminated: ok {rc=0} 22:16:09.943118 --- ParallelTerminationStrategy: PID 20207 died... 22:16:09.961896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20207): Terminated: ok {rc=0} 22:16:10.007002 --- ParallelTerminationStrategy: PID 20210 died... 22:16:10.025971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20210): Terminated: ok {rc=0} 22:16:10.111304 bus /gobi_4: Setting Powered False 22:16:11.211718 bus /gobi_4: Setting Powered False 22:16:12.331762 bus /gobi_1: Setting Powered False 22:16:13.431647 bus /gobi_1: Setting Powered False 22:16:14.548282 bus /gobi_0: Setting Powered False 22:16:15.649369 bus /gobi_0: Setting Powered False 22:16:16.766524 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 22:16:17.871281 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:17.882523 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:16:17.931402 tst ping.py: using LAC 17112 22:16:18.050152 tst ping.py: using RAC 27 22:16:18.166602 tst ping.py: using CellId 17112 22:16:18.285357 tst ping.py: using BVCI 17113 22:16:18.393094 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:18.403705 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:18.414442 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:18.425208 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:18.435915 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:18.446617 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:18.457523 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:18.468253 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:16:18.585036 tst ping.py:19: start network... 22:16:18.799564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:16:19.291000 run create_hlr_db(pid=20212): Launched 22:16:19.420781 bus /gobi_6: Setting Powered False 22:16:20.484274 run create_hlr_db(pid=20212): Terminated: ok {rc=0} 22:16:20.909113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20214): Launched 22:16:21.205387 run osmo-hlr_10.42.42.2(pid=20215): Launched 22:16:21.317924 run osmo-stp_10.42.42.5: Starting osmo-stp 22:16:21.834035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20217): Launched 22:16:22.131171 run osmo-stp_10.42.42.5(pid=20218): Launched 22:16:22.243662 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:16:22.755810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20220): Launched 22:16:22.869507 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:16:23.120540 run patchelf(pid=20221): Launched 22:16:23.286702 run osmo-stp_10.42.42.5(pid=20218): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20218)] 22:16:23.413957 run osmo-stp_10.42.42.5(pid=20218): stdout: | (launched: 2022-12-08_22:16:22.076813) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:23.542545 run osmo-stp_10.42.42.5(pid=20218): stderr: | 20221208221622245 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221622245 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221622246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221622246 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221622247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221622247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221622247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:23.670971 run osmo-stp_10.42.42.5(pid=20218): stdout: | (launched: 2022-12-08_22:16:22.076813) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:23.793792 run osmo-stp_10.42.42.5(pid=20218): stderr: | 20221208221622245 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221622245 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221622246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221622246 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221622247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221622247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221622247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:23.939029 run patchelf(pid=20221): Terminating (SIGINT) 22:16:24.107039 run patchelf(pid=20221): Terminated: ok {rc=0} 22:16:24.228065 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20218): Process ended prematurely: osmo-stp_10.42.42.5(pid=20218) [trial-2350↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20218)] [trial-2350↪gprs:trx-sysmocell5000↪ping.py:22] 22:16:24.237020 tst ping.py:22: Test FAILED (6.4 sec) 22:16:24.264794 run osmo-hlr_10.42.42.2(pid=20215): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20215)] 22:16:24.314196 run osmo-hlr_10.42.42.2(pid=20215): stdout: | (launched: 2022-12-08_22:16:21.151609) 22:16:24.365600 run osmo-hlr_10.42.42.2(pid=20215): stderr: | 20221208221621327 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221621327 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221621327 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221621327 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221621328 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221621328 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221621341 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221621350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221621350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221621350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:16:24.417152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20214): Terminating (SIGTERM) 22:16:24.458634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20217): Terminating (SIGTERM) 22:16:24.500121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20220): Terminating (SIGTERM) 22:16:24.541710 --- ParallelTerminationStrategy: PID 20214 died... 22:16:24.561407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20214): Terminated: ok {rc=0} 22:16:24.607469 --- ParallelTerminationStrategy: PID 20217 died... 22:16:24.626716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20217): Terminated: ok {rc=0} 22:16:24.673260 --- ParallelTerminationStrategy: PID 20220 died... 22:16:24.692277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20220): Terminated: ok {rc=0} 22:16:24.778389 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 22:16:25.866919 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:25.879017 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:16:25.931713 tst ping_idle_ping.py: using LAC 17113 22:16:26.057358 tst ping_idle_ping.py: using RAC 28 22:16:26.181085 tst ping_idle_ping.py: using CellId 17113 22:16:26.304828 tst ping_idle_ping.py: using BVCI 17114 22:16:26.420222 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:26.431646 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:26.442613 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:26.453560 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:26.464341 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:26.475234 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:26.486379 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:26.497327 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:16:26.609887 tst ping_idle_ping.py:24: start network... 22:16:26.810343 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:16:27.275033 run create_hlr_db(pid=20222): Launched 22:16:27.389798 bus /gobi_6: Setting Powered False 22:16:28.449832 run create_hlr_db(pid=20222): Terminated: ok {rc=0} 22:16:28.887548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20224): Launched 22:16:29.206370 run osmo-hlr_10.42.42.2(pid=20225): Launched 22:16:29.328686 run osmo-stp_10.42.42.5: Starting osmo-stp 22:16:29.881992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20227): Launched 22:16:30.199149 run osmo-stp_10.42.42.5(pid=20228): Launched 22:16:30.320182 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:16:30.879479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20230): Launched 22:16:31.018868 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:16:31.298305 run patchelf(pid=20231): Launched 22:16:31.486915 run osmo-stp_10.42.42.5(pid=20228): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20228)] 22:16:31.624782 run osmo-stp_10.42.42.5(pid=20228): stdout: | (launched: 2022-12-08_22:16:30.142090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:31.763865 run osmo-stp_10.42.42.5(pid=20228): stderr: | 20221208221630330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221630330 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221630331 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221630331 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221630333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221630334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221630334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:31.904688 run osmo-stp_10.42.42.5(pid=20228): stdout: | (launched: 2022-12-08_22:16:30.142090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:32.037995 run osmo-stp_10.42.42.5(pid=20228): stderr: | 20221208221630330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221630330 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221630331 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221630331 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221630333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221630334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221630334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:32.195510 run patchelf(pid=20231): Terminating (SIGINT) 22:16:32.375364 run patchelf(pid=20231): Terminated: ok {rc=0} 22:16:32.504840 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20228): Process ended prematurely: osmo-stp_10.42.42.5(pid=20228) [trial-2350↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20228)] [trial-2350↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 22:16:32.514494 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:16:32.542880 run osmo-hlr_10.42.42.2(pid=20225): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20225)] 22:16:32.593880 run osmo-hlr_10.42.42.2(pid=20225): stdout: | (launched: 2022-12-08_22:16:29.148933) 22:16:32.646674 run osmo-hlr_10.42.42.2(pid=20225): stderr: | 20221208221629347 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221629347 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221629347 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221629347 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221629347 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221629347 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221629360 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221629370 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221629370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221629370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:16:32.700196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20224): Terminating (SIGTERM) 22:16:32.742949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20227): Terminating (SIGTERM) 22:16:32.785745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20230): Terminating (SIGTERM) 22:16:32.828715 --- ParallelTerminationStrategy: PID 20224 died... 22:16:32.849134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20224): Terminated: ok {rc=0} 22:16:32.896901 --- ParallelTerminationStrategy: PID 20227 died... 22:16:32.917095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20227): Terminated: ok {rc=0} 22:16:32.964602 --- ParallelTerminationStrategy: PID 20230 died... 22:16:32.984991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20230): Terminated: ok {rc=0} 22:16:33.074557 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 22:16:34.386321 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:16:34.392047 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:16:34.425960 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:16:34.464732 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:16:34.554004 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:16:34.588287 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:16:34.626923 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:16:35.221982 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:16:35.274282 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:35.285236 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:16:35.336895 tst cs_paging_gprs_active.py: using LAC 17114 22:16:35.458774 tst cs_paging_gprs_active.py: using RAC 29 22:16:35.582243 tst cs_paging_gprs_active.py: using CellId 17114 22:16:35.705313 tst cs_paging_gprs_active.py: using BVCI 17115 22:16:35.816029 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:35.827138 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:35.838022 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:35.849401 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:35.860675 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:35.872059 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:35.883587 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:35.894910 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:35.906573 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:16:36.027930 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:16:36.145879 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:16:36.351600 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:16:36.656372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20235): Launched 22:16:36.922150 run iperf3-srv_10.42.42.10(pid=20236): Launched 22:16:37.036446 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:16:37.240279 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:16:37.544566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20237): Launched 22:16:37.809137 run iperf3-srv_10.42.42.10(pid=20238): Launched 22:16:37.923885 tst cs_paging_gprs_active.py:38: start network... 22:16:38.127428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:16:38.599351 run create_hlr_db(pid=20239): Launched 22:16:38.715909 bus /gobi_6: Setting Powered False 22:16:39.776100 run create_hlr_db(pid=20239): Terminated: ok {rc=0} 22:16:40.201398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20241): Launched 22:16:40.506343 run osmo-hlr_10.42.42.2(pid=20242): Launched 22:16:40.622277 run osmo-stp_10.42.42.5: Starting osmo-stp 22:16:41.161836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20244): Launched 22:16:41.464854 run osmo-stp_10.42.42.5(pid=20245): Launched 22:16:41.580495 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:16:42.116348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20247): Launched 22:16:42.233390 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:16:42.489518 run patchelf(pid=20248): Launched 22:16:42.659030 run osmo-stp_10.42.42.5(pid=20245): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20245)] 22:16:42.788699 run osmo-stp_10.42.42.5(pid=20245): stdout: | (launched: 2022-12-08_22:16:41.409863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:42.920034 run osmo-stp_10.42.42.5(pid=20245): stderr: | 20221208221641580 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221641580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221641580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221641581 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221641581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221641581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221641581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:43.051290 run osmo-stp_10.42.42.5(pid=20245): stdout: | (launched: 2022-12-08_22:16:41.409863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:43.177849 run osmo-stp_10.42.42.5(pid=20245): stderr: | 20221208221641580 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221641580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221641580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221641581 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221641581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221641581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221641581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:43.327268 run patchelf(pid=20248): Terminating (SIGINT) 22:16:43.498256 run patchelf(pid=20248): Terminated: ok {rc=0} 22:16:43.621918 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20245): Process ended prematurely: osmo-stp_10.42.42.5(pid=20245) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20245)] [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:16:43.631243 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 22:16:43.658813 run osmo-hlr_10.42.42.2(pid=20242): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20242)] 22:16:43.707850 run osmo-hlr_10.42.42.2(pid=20242): stdout: | (launched: 2022-12-08_22:16:40.451588) 22:16:43.758381 run osmo-hlr_10.42.42.2(pid=20242): stderr: | 20221208221640627 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221640627 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221640627 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221640627 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221640627 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221640627 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221640639 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221640649 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221640650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221640650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:16:43.809341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20235): Terminating (SIGTERM) 22:16:43.850218 run iperf3-srv_10.42.42.10(pid=20236): Terminating (SIGTERM) 22:16:43.891069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20237): Terminating (SIGTERM) 22:16:43.932160 run iperf3-srv_10.42.42.10(pid=20238): Terminating (SIGTERM) 22:16:43.972842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20241): Terminating (SIGTERM) 22:16:44.013710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20244): Terminating (SIGTERM) 22:16:44.054422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20247): Terminating (SIGTERM) 22:16:44.095390 --- ParallelTerminationStrategy: PID 20235 died... 22:16:44.114761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20235): Terminated: ok {rc=0} 22:16:44.160291 --- ParallelTerminationStrategy: PID 20236 died... 22:16:44.179240 run iperf3-srv_10.42.42.10(pid=20236): Terminated {rc=256} 22:16:44.224486 --- ParallelTerminationStrategy: PID 20237 died... 22:16:44.243352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20237): Terminated: ok {rc=0} 22:16:44.288499 --- ParallelTerminationStrategy: PID 20238 died... 22:16:44.307495 run iperf3-srv_10.42.42.10(pid=20238): Terminated {rc=256} 22:16:44.352591 --- ParallelTerminationStrategy: PID 20241 died... 22:16:44.371523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20241): Terminated: ok {rc=0} 22:16:44.416528 --- ParallelTerminationStrategy: PID 20244 died... 22:16:44.435447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20244): Terminated: ok {rc=0} 22:16:44.480628 --- ParallelTerminationStrategy: PID 20247 died... 22:16:44.499620 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20247): Terminated: ok {rc=0} 22:16:44.586861 bus /gobi_0: Setting Powered False 22:16:45.686740 bus /gobi_0: Setting Powered False 22:16:46.815086 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:16:47.980689 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:47.992041 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:16:48.047623 tst iperf3.py: using LAC 17115 22:16:48.165165 tst iperf3.py: using RAC 30 22:16:48.282855 tst iperf3.py: using CellId 17115 22:16:48.402699 tst iperf3.py: using BVCI 17116 22:16:48.514569 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:48.525498 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:48.536111 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:48.547008 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:48.557912 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:48.568697 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:48.579777 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:48.590624 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:48.601699 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:16:48.718408 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:16:48.920748 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:16:49.224280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20249): Launched 22:16:49.486648 run iperf3-srv_10.42.42.10(pid=20250): Launched 22:16:49.599532 tst iperf3.py:8: start network... 22:16:49.801906 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:16:50.270682 run create_hlr_db(pid=20251): Launched 22:16:50.385434 bus /gobi_6: Setting Powered False 22:16:51.446503 run create_hlr_db(pid=20251): Terminated: ok {rc=0} 22:16:51.868127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20253): Launched 22:16:52.171267 run osmo-hlr_10.42.42.2(pid=20254): Launched 22:16:52.287063 run osmo-stp_10.42.42.5: Starting osmo-stp 22:16:52.813187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20256): Launched 22:16:53.115195 run osmo-stp_10.42.42.5(pid=20257): Launched 22:16:53.230245 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:16:53.752481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20259): Launched 22:16:53.868716 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:16:54.126628 run patchelf(pid=20260): Launched 22:16:54.295494 run osmo-stp_10.42.42.5(pid=20257): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20257)] 22:16:54.424338 run osmo-stp_10.42.42.5(pid=20257): stdout: | (launched: 2022-12-08_22:16:53.060423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:54.554831 run osmo-stp_10.42.42.5(pid=20257): stderr: | 20221208221653229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221653229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221653229 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221653230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221653230 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221653230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221653230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:54.685587 run osmo-stp_10.42.42.5(pid=20257): stdout: | (launched: 2022-12-08_22:16:53.060423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:54.811040 run osmo-stp_10.42.42.5(pid=20257): stderr: | 20221208221653229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221653229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221653229 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221653230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221653230 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221653230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221653230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:54.958968 run patchelf(pid=20260): Terminating (SIGINT) 22:16:55.129681 run patchelf(pid=20260): Terminated: ok {rc=0} 22:16:55.252558 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20257): Process ended prematurely: osmo-stp_10.42.42.5(pid=20257) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20257)] [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 22:16:55.262181 tst iperf3.py:8: Test FAILED (7.3 sec) 22:16:55.290413 run osmo-hlr_10.42.42.2(pid=20254): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20254)] 22:16:55.339019 run osmo-hlr_10.42.42.2(pid=20254): stdout: | (launched: 2022-12-08_22:16:52.116200) 22:16:55.390084 run osmo-hlr_10.42.42.2(pid=20254): stderr: | 20221208221652290 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221652290 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221652290 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221652291 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221652291 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221652291 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221652303 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221652313 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221652314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221652314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:16:55.441065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20249): Terminating (SIGTERM) 22:16:55.481643 run iperf3-srv_10.42.42.10(pid=20250): Terminating (SIGTERM) 22:16:55.522377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20253): Terminating (SIGTERM) 22:16:55.563225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20256): Terminating (SIGTERM) 22:16:55.604047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20259): Terminating (SIGTERM) 22:16:55.645122 --- ParallelTerminationStrategy: PID 20249 died... 22:16:55.664499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20249): Terminated: ok {rc=0} 22:16:55.710125 --- ParallelTerminationStrategy: PID 20250 died... 22:16:55.729061 run iperf3-srv_10.42.42.10(pid=20250): Terminated {rc=256} 22:16:55.774430 --- ParallelTerminationStrategy: PID 20253 died... 22:16:55.793378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20253): Terminated: ok {rc=0} 22:16:55.838798 --- ParallelTerminationStrategy: PID 20256 died... 22:16:55.857848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20256): Terminated: ok {rc=0} 22:16:55.903388 --- ParallelTerminationStrategy: PID 20259 died... 22:16:55.922337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20259): Terminated: ok {rc=0} 22:16:56.009713 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:16:57.160597 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:57.172676 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:16:57.230586 tst iperf3m4.py: using LAC 17116 22:16:57.360890 tst iperf3m4.py: using RAC 31 22:16:57.488229 tst iperf3m4.py: using CellId 17116 22:16:57.614924 tst iperf3m4.py: using BVCI 17117 22:16:57.732815 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:57.744297 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:57.755547 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:57.766843 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:57.778090 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:57.789280 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:57.800464 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:57.811676 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:57.822989 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:16:57.943691 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:16:58.064601 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:16:58.181999 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:16:58.301066 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:16:58.519828 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:16:58.843518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20261): Launched 22:16:59.124776 run iperf3-srv_10.42.42.10(pid=20262): Launched 22:16:59.246293 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:16:59.464549 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:16:59.789218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20263): Launched 22:17:00.071593 run iperf3-srv_10.42.42.10(pid=20264): Launched 22:17:00.192728 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:17:00.410265 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:17:00.734190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20265): Launched 22:17:01.045830 run iperf3-srv_10.42.42.10(pid=20266): Launched 22:17:01.194878 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:17:01.405781 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:17:01.733717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20270): Launched 22:17:02.013722 run iperf3-srv_10.42.42.10(pid=20271): Launched 22:17:02.150169 tst iperf3m4.py:8: start network... 22:17:02.388407 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:17:02.857427 run create_hlr_db(pid=20272): Launched 22:17:02.973405 bus /gobi_6: Setting Powered False 22:17:04.033600 run create_hlr_db(pid=20272): Terminated: ok {rc=0} 22:17:04.456005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20274): Launched 22:17:04.757579 run osmo-hlr_10.42.42.2(pid=20275): Launched 22:17:04.873236 run osmo-stp_10.42.42.5: Starting osmo-stp 22:17:05.411711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20277): Launched 22:17:05.714763 run osmo-stp_10.42.42.5(pid=20278): Launched 22:17:05.829926 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:17:06.353447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20280): Launched 22:17:06.470462 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:17:06.727845 run patchelf(pid=20281): Launched 22:17:06.897479 run osmo-stp_10.42.42.5(pid=20278): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20278)] 22:17:07.026429 run osmo-stp_10.42.42.5(pid=20278): stdout: | (launched: 2022-12-08_22:17:05.659625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:07.156597 run osmo-stp_10.42.42.5(pid=20278): stderr: | 20221208221705830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221705830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221705830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221705831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221705831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221705831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221705831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:07.287155 run osmo-stp_10.42.42.5(pid=20278): stdout: | (launched: 2022-12-08_22:17:05.659625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:07.412199 run osmo-stp_10.42.42.5(pid=20278): stderr: | 20221208221705830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221705830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221705830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221705831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221705831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221705831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221705831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:07.560561 run patchelf(pid=20281): Terminating (SIGINT) 22:17:07.731603 run patchelf(pid=20281): Terminated: ok {rc=0} 22:17:07.855045 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20278): Process ended prematurely: osmo-stp_10.42.42.5(pid=20278) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20278)] [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 22:17:07.864576 tst iperf3m4.py:8: Test FAILED (10.7 sec) 22:17:07.893092 run osmo-hlr_10.42.42.2(pid=20275): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20275)] 22:17:07.942098 run osmo-hlr_10.42.42.2(pid=20275): stdout: | (launched: 2022-12-08_22:17:04.702676) 22:17:07.992587 run osmo-hlr_10.42.42.2(pid=20275): stderr: | 20221208221704880 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221704880 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221704880 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221704880 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221704880 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221704880 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221704892 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221704902 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221704902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221704902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:17:08.043267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20261): Terminating (SIGTERM) 22:17:08.083968 run iperf3-srv_10.42.42.10(pid=20262): Terminating (SIGTERM) 22:17:08.124613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20263): Terminating (SIGTERM) 22:17:08.165326 run iperf3-srv_10.42.42.10(pid=20264): Terminating (SIGTERM) 22:17:08.206065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20265): Terminating (SIGTERM) 22:17:08.246645 run iperf3-srv_10.42.42.10(pid=20266): Terminating (SIGTERM) 22:17:08.287050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20270): Terminating (SIGTERM) 22:17:08.327666 run iperf3-srv_10.42.42.10(pid=20271): Terminating (SIGTERM) 22:17:08.367955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20274): Terminating (SIGTERM) 22:17:08.408386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20277): Terminating (SIGTERM) 22:17:08.448858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20280): Terminating (SIGTERM) 22:17:08.490322 --- ParallelTerminationStrategy: PID 20261 died... 22:17:08.509453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20261): Terminated: ok {rc=0} 22:17:08.554721 --- ParallelTerminationStrategy: PID 20262 died... 22:17:08.573372 run iperf3-srv_10.42.42.10(pid=20262): Terminated {rc=256} 22:17:08.618212 --- ParallelTerminationStrategy: PID 20263 died... 22:17:08.636881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20263): Terminated: ok {rc=0} 22:17:08.681869 --- ParallelTerminationStrategy: PID 20264 died... 22:17:08.700581 run iperf3-srv_10.42.42.10(pid=20264): Terminated {rc=256} 22:17:08.745322 --- ParallelTerminationStrategy: PID 20265 died... 22:17:08.764388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20265): Terminated: ok {rc=0} 22:17:08.809528 --- ParallelTerminationStrategy: PID 20266 died... 22:17:08.828251 run iperf3-srv_10.42.42.10(pid=20266): Terminated {rc=256} 22:17:08.873222 --- ParallelTerminationStrategy: PID 20270 died... 22:17:08.891838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20270): Terminated: ok {rc=0} 22:17:08.937055 --- ParallelTerminationStrategy: PID 20271 died... 22:17:08.955953 run iperf3-srv_10.42.42.10(pid=20271): Terminated {rc=256} 22:17:09.000786 --- ParallelTerminationStrategy: PID 20274 died... 22:17:09.019639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20274): Terminated: ok {rc=0} 22:17:09.064651 --- ParallelTerminationStrategy: PID 20277 died... 22:17:09.083624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20277): Terminated: ok {rc=0} 22:17:09.128729 --- ParallelTerminationStrategy: PID 20280 died... 22:17:09.147672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20280): Terminated: ok {rc=0} 22:17:09.235774 bus /gobi_4: Setting Powered False 22:17:10.337231 bus /gobi_4: Setting Powered False 22:17:11.453452 bus /gobi_1: Setting Powered False 22:17:12.553221 bus /gobi_1: Setting Powered False 22:17:13.669428 bus /gobi_0: Setting Powered False 22:17:14.768087 bus /gobi_0: Setting Powered False 22:17:15.913596 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 22:17:17.016643 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:17.029473 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:17:17.084636 tst ping.py: using LAC 17117 22:17:17.206521 tst ping.py: using RAC 32 22:17:17.335492 tst ping.py: using CellId 17117 22:17:17.462800 tst ping.py: using BVCI 17118 22:17:17.580442 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:17.592002 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:17.603251 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:17.614495 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:17.625681 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:17.636774 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:17.648193 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:17.659453 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:17:17.779302 tst ping.py:19: start network... 22:17:17.992638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:17:18.483208 run create_hlr_db(pid=20282): Launched 22:17:18.611964 bus /gobi_6: Setting Powered False 22:17:19.675851 run create_hlr_db(pid=20282): Terminated: ok {rc=0} 22:17:20.102310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20284): Launched 22:17:20.399964 run osmo-hlr_10.42.42.2(pid=20285): Launched 22:17:20.513468 run osmo-stp_10.42.42.5: Starting osmo-stp 22:17:21.049575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20287): Launched 22:17:21.349636 run osmo-stp_10.42.42.5(pid=20288): Launched 22:17:21.463925 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:17:21.981558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20290): Launched 22:17:22.095968 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:17:22.349833 run patchelf(pid=20291): Launched 22:17:22.515858 run osmo-stp_10.42.42.5(pid=20288): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20288)] 22:17:22.642976 run osmo-stp_10.42.42.5(pid=20288): stdout: | (launched: 2022-12-08_22:17:21.294260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:22.771204 run osmo-stp_10.42.42.5(pid=20288): stderr: | 20221208221721464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221721464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221721464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221721465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221721465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221721465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221721465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:22.900228 run osmo-stp_10.42.42.5(pid=20288): stdout: | (launched: 2022-12-08_22:17:21.294260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:23.023283 run osmo-stp_10.42.42.5(pid=20288): stderr: | 20221208221721464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221721464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221721464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221721465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221721465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221721465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221721465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:23.168904 run patchelf(pid=20291): Terminating (SIGINT) 22:17:23.337294 run patchelf(pid=20291): Terminated: ok {rc=0} 22:17:23.458547 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20288): Process ended prematurely: osmo-stp_10.42.42.5(pid=20288) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20288)] [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 22:17:23.467364 tst ping.py:22: Test FAILED (6.4 sec) 22:17:23.494641 run osmo-hlr_10.42.42.2(pid=20285): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20285)] 22:17:23.543685 run osmo-hlr_10.42.42.2(pid=20285): stdout: | (launched: 2022-12-08_22:17:20.345722) 22:17:23.594148 run osmo-hlr_10.42.42.2(pid=20285): stderr: | 20221208221720523 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221720523 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221720523 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221720523 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221720523 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221720523 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221720537 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221720546 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221720546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221720546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:17:23.645386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20284): Terminating (SIGTERM) 22:17:23.686081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20287): Terminating (SIGTERM) 22:17:23.726656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20290): Terminating (SIGTERM) 22:17:23.767488 --- ParallelTerminationStrategy: PID 20284 died... 22:17:23.786839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20284): Terminated: ok {rc=0} 22:17:23.832940 --- ParallelTerminationStrategy: PID 20287 died... 22:17:23.852064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20287): Terminated: ok {rc=0} 22:17:23.897664 --- ParallelTerminationStrategy: PID 20290 died... 22:17:23.916635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20290): Terminated: ok {rc=0} 22:17:24.001534 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:17:25.087569 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:25.099346 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:17:25.154390 tst ping_idle_ping.py: using LAC 17118 22:17:25.272524 tst ping_idle_ping.py: using RAC 33 22:17:25.388411 tst ping_idle_ping.py: using CellId 17118 22:17:25.504774 tst ping_idle_ping.py: using BVCI 17119 22:17:25.613548 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:25.624560 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:25.635402 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:25.646558 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:25.658330 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:25.669568 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:25.680785 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:25.691852 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:17:25.811382 tst ping_idle_ping.py:24: start network... 22:17:26.026632 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:17:26.521371 run create_hlr_db(pid=20292): Launched 22:17:26.651449 bus /gobi_6: Setting Powered False 22:17:27.714772 run create_hlr_db(pid=20292): Terminated: ok {rc=0} 22:17:28.143074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20294): Launched 22:17:28.441112 run osmo-hlr_10.42.42.2(pid=20295): Launched 22:17:28.555246 run osmo-stp_10.42.42.5: Starting osmo-stp 22:17:29.082503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20297): Launched 22:17:29.379790 run osmo-stp_10.42.42.5(pid=20298): Launched 22:17:29.492748 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:17:30.007578 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20300): Launched 22:17:30.121579 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:17:30.374117 run patchelf(pid=20301): Launched 22:17:30.540145 run osmo-stp_10.42.42.5(pid=20298): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20298)] 22:17:30.667778 run osmo-stp_10.42.42.5(pid=20298): stdout: | (launched: 2022-12-08_22:17:29.325540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:30.796487 run osmo-stp_10.42.42.5(pid=20298): stderr: | 20221208221729496 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221729496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221729496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221729497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221729497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221729497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221729497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:30.955120 run osmo-stp_10.42.42.5(pid=20298): stdout: | (launched: 2022-12-08_22:17:29.325540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:31.080899 run osmo-stp_10.42.42.5(pid=20298): stderr: | 20221208221729496 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221729496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221729496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221729497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221729497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221729497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221729497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:31.230638 run patchelf(pid=20301): Terminating (SIGINT) 22:17:31.403605 run patchelf(pid=20301): Terminated: ok {rc=0} 22:17:31.528469 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20298): Process ended prematurely: osmo-stp_10.42.42.5(pid=20298) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20298)] [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 22:17:31.538644 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:17:31.568496 run osmo-hlr_10.42.42.2(pid=20295): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20295)] 22:17:31.620749 run osmo-hlr_10.42.42.2(pid=20295): stdout: | (launched: 2022-12-08_22:17:28.387127) 22:17:31.673595 run osmo-hlr_10.42.42.2(pid=20295): stderr: | 20221208221728563 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221728563 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221728563 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221728563 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221728563 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221728563 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221728575 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221728584 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221728584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221728584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:17:31.727028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20294): Terminating (SIGTERM) 22:17:31.769857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20297): Terminating (SIGTERM) 22:17:31.813263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20300): Terminating (SIGTERM) 22:17:31.857733 --- ParallelTerminationStrategy: PID 20294 died... 22:17:31.877851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20294): Terminated: ok {rc=0} 22:17:31.926321 --- ParallelTerminationStrategy: PID 20297 died... 22:17:31.946145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20297): Terminated: ok {rc=0} 22:17:31.994234 --- ParallelTerminationStrategy: PID 20300 died... 22:17:32.014130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20300): Terminated: ok {rc=0} 22:17:32.102563 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:17:33.409264 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:17:33.415260 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:17:33.450914 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:17:33.489623 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:17:33.576584 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:17:33.610663 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:17:33.649413 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:17:34.247342 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:17:34.299244 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:34.310766 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:17:34.382523 tst cs_paging_gprs_active.py: using LAC 17119 22:17:34.511131 tst cs_paging_gprs_active.py: using RAC 34 22:17:34.637295 tst cs_paging_gprs_active.py: using CellId 17119 22:17:34.763402 tst cs_paging_gprs_active.py: using BVCI 17120 22:17:34.880480 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:34.891908 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:34.903190 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:34.914790 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:34.926165 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:34.937371 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:34.948658 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:34.959866 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:34.971514 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:17:35.087798 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:17:35.205343 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:17:35.424205 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:17:35.749753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20308): Launched 22:17:36.015565 run iperf3-srv_10.42.42.10(pid=20309): Launched 22:17:36.130325 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:17:36.334224 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:17:36.638821 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20310): Launched 22:17:36.902625 run iperf3-srv_10.42.42.10(pid=20311): Launched 22:17:37.016389 tst cs_paging_gprs_active.py:38: start network... 22:17:37.218954 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:17:37.689538 run create_hlr_db(pid=20312): Launched 22:17:37.807231 bus /gobi_6: Setting Powered False 22:17:38.868255 run create_hlr_db(pid=20312): Terminated: ok {rc=0} 22:17:39.311141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20314): Launched 22:17:39.619514 run osmo-hlr_10.42.42.2(pid=20315): Launched 22:17:39.735084 run osmo-stp_10.42.42.5: Starting osmo-stp 22:17:40.275150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20317): Launched 22:17:40.580059 run osmo-stp_10.42.42.5(pid=20318): Launched 22:17:40.696529 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:17:41.221544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20320): Launched 22:17:41.338523 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:17:41.596176 run patchelf(pid=20321): Launched 22:17:41.765588 run osmo-stp_10.42.42.5(pid=20318): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20318)] 22:17:41.895316 run osmo-stp_10.42.42.5(pid=20318): stdout: | (launched: 2022-12-08_22:17:40.524680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:42.026489 run osmo-stp_10.42.42.5(pid=20318): stderr: | 20221208221740698 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221740698 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221740698 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221740699 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221740699 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221740699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221740699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:42.158134 run osmo-stp_10.42.42.5(pid=20318): stdout: | (launched: 2022-12-08_22:17:40.524680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:42.284132 run osmo-stp_10.42.42.5(pid=20318): stderr: | 20221208221740698 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221740698 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221740698 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221740699 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221740699 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221740699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221740699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:42.433812 run patchelf(pid=20321): Terminating (SIGINT) 22:17:42.604634 run patchelf(pid=20321): Terminated: ok {rc=0} 22:17:42.728101 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20318): Process ended prematurely: osmo-stp_10.42.42.5(pid=20318) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20318)] [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:17:42.737665 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 22:17:42.765331 run osmo-hlr_10.42.42.2(pid=20315): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20315)] 22:17:42.814812 run osmo-hlr_10.42.42.2(pid=20315): stdout: | (launched: 2022-12-08_22:17:39.564060) 22:17:42.865672 run osmo-hlr_10.42.42.2(pid=20315): stderr: | 20221208221739741 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221739741 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221739741 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221739741 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221739741 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221739741 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221739752 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221739761 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221739762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221739762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:17:42.916540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20308): Terminating (SIGTERM) 22:17:42.957430 run iperf3-srv_10.42.42.10(pid=20309): Terminating (SIGTERM) 22:17:42.998338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20310): Terminating (SIGTERM) 22:17:43.039289 run iperf3-srv_10.42.42.10(pid=20311): Terminating (SIGTERM) 22:17:43.079958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20314): Terminating (SIGTERM) 22:17:43.120779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20317): Terminating (SIGTERM) 22:17:43.161850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20320): Terminating (SIGTERM) 22:17:43.202888 --- ParallelTerminationStrategy: PID 20308 died... 22:17:43.222216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20308): Terminated: ok {rc=0} 22:17:43.267455 --- ParallelTerminationStrategy: PID 20309 died... 22:17:43.286302 run iperf3-srv_10.42.42.10(pid=20309): Terminated {rc=256} 22:17:43.331334 --- ParallelTerminationStrategy: PID 20310 died... 22:17:43.350295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20310): Terminated: ok {rc=0} 22:17:43.395362 --- ParallelTerminationStrategy: PID 20311 died... 22:17:43.414276 run iperf3-srv_10.42.42.10(pid=20311): Terminated {rc=256} 22:17:43.459159 --- ParallelTerminationStrategy: PID 20314 died... 22:17:43.478161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20314): Terminated: ok {rc=0} 22:17:43.523095 --- ParallelTerminationStrategy: PID 20317 died... 22:17:43.542192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20317): Terminated: ok {rc=0} 22:17:43.587333 --- ParallelTerminationStrategy: PID 20320 died... 22:17:43.606222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20320): Terminated: ok {rc=0} 22:17:43.692129 bus /gobi_0: Setting Powered False 22:17:44.793304 bus /gobi_0: Setting Powered False 22:17:45.923011 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:17:47.075420 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:47.088047 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:17:47.162596 tst iperf3.py: using LAC 17120 22:17:47.284103 tst iperf3.py: using RAC 35 22:17:47.404286 tst iperf3.py: using CellId 17120 22:17:47.523991 tst iperf3.py: using BVCI 17121 22:17:47.636527 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:47.647632 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:47.658604 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:47.669772 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:47.680741 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:47.691891 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:47.703091 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:47.714106 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:47.725320 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:17:47.843831 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:17:48.064388 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:17:48.389283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20322): Launched 22:17:48.670736 run iperf3-srv_10.42.42.10(pid=20323): Launched 22:17:48.793828 tst iperf3.py:8: start network... 22:17:49.012779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:17:49.514892 run create_hlr_db(pid=20324): Launched 22:17:49.647260 bus /gobi_6: Setting Powered False 22:17:50.711812 run create_hlr_db(pid=20324): Terminated: ok {rc=0} 22:17:51.164715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20326): Launched 22:17:51.488299 run osmo-hlr_10.42.42.2(pid=20327): Launched 22:17:51.611243 run osmo-stp_10.42.42.5: Starting osmo-stp 22:17:52.174412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20329): Launched 22:17:52.497451 run osmo-stp_10.42.42.5(pid=20330): Launched 22:17:52.620522 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:17:53.184218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20332): Launched 22:17:53.307895 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:17:53.581270 run patchelf(pid=20333): Launched 22:17:53.761846 run osmo-stp_10.42.42.5(pid=20330): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20330)] 22:17:53.899346 run osmo-stp_10.42.42.5(pid=20330): stdout: | (launched: 2022-12-08_22:17:52.439081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:54.038887 run osmo-stp_10.42.42.5(pid=20330): stderr: | 20221208221752632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221752632 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221752632 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221752633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221752633 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221752633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221752634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:54.178249 run osmo-stp_10.42.42.5(pid=20330): stdout: | (launched: 2022-12-08_22:17:52.439081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:54.311638 run osmo-stp_10.42.42.5(pid=20330): stderr: | 20221208221752632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221752632 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221752632 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221752633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221752633 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221752633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221752634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:54.470287 run patchelf(pid=20333): Terminating (SIGINT) 22:17:54.652838 run patchelf(pid=20333): Terminated: ok {rc=0} 22:17:54.784231 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20330): Process ended prematurely: osmo-stp_10.42.42.5(pid=20330) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20330)] [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 22:17:54.794979 tst iperf3.py:8: Test FAILED (7.8 sec) 22:17:54.823787 run osmo-hlr_10.42.42.2(pid=20327): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20327)] 22:17:54.874869 run osmo-hlr_10.42.42.2(pid=20327): stdout: | (launched: 2022-12-08_22:17:51.429870) 22:17:54.928220 run osmo-hlr_10.42.42.2(pid=20327): stderr: | 20221208221751630 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221751630 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221751630 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221751630 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221751630 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221751630 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221751642 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221751650 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221751651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221751651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:17:54.981639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20322): Terminating (SIGTERM) 22:17:55.024000 run iperf3-srv_10.42.42.10(pid=20323): Terminating (SIGTERM) 22:17:55.066491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20326): Terminating (SIGTERM) 22:17:55.108933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20329): Terminating (SIGTERM) 22:17:55.151422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20332): Terminating (SIGTERM) 22:17:55.194170 --- ParallelTerminationStrategy: PID 20322 died... 22:17:55.214337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20322): Terminated: ok {rc=0} 22:17:55.261474 --- ParallelTerminationStrategy: PID 20323 died... 22:17:55.281234 run iperf3-srv_10.42.42.10(pid=20323): Terminated {rc=256} 22:17:55.328303 --- ParallelTerminationStrategy: PID 20326 died... 22:17:55.348291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20326): Terminated: ok {rc=0} 22:17:55.395031 --- ParallelTerminationStrategy: PID 20329 died... 22:17:55.414947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20329): Terminated: ok {rc=0} 22:17:55.461799 --- ParallelTerminationStrategy: PID 20332 died... 22:17:55.481606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20332): Terminated: ok {rc=0} 22:17:55.569528 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:17:56.717704 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:56.729510 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:17:56.800685 tst iperf3m4.py: using LAC 17121 22:17:56.922533 tst iperf3m4.py: using RAC 36 22:17:57.044361 tst iperf3m4.py: using CellId 17121 22:17:57.165739 tst iperf3m4.py: using BVCI 17122 22:17:57.285109 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:57.296770 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:57.308515 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:57.320121 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:57.331661 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:57.343256 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:57.355063 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:57.366440 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:57.377990 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:17:57.493034 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:17:57.613918 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:17:57.730833 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:17:57.849756 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:17:58.052508 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:17:58.356273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20334): Launched 22:17:58.621318 run iperf3-srv_10.42.42.10(pid=20335): Launched 22:17:58.735375 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:17:58.939295 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:17:59.243678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20336): Launched 22:17:59.506743 run iperf3-srv_10.42.42.10(pid=20337): Launched 22:17:59.621268 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:17:59.824570 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:18:00.129277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20338): Launched 22:18:00.392088 run iperf3-srv_10.42.42.10(pid=20339): Launched 22:18:00.506522 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:18:00.710177 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:18:01.022718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20340): Launched 22:18:01.301449 run iperf3-srv_10.42.42.10(pid=20341): Launched 22:18:01.433584 tst iperf3m4.py:8: start network... 22:18:01.640550 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:18:02.121110 run create_hlr_db(pid=20342): Launched 22:18:02.253545 bus /gobi_6: Setting Powered False 22:18:03.313927 run create_hlr_db(pid=20342): Terminated: ok {rc=0} 22:18:03.755706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20344): Launched 22:18:04.079543 run osmo-hlr_10.42.42.2(pid=20345): Launched 22:18:04.202978 run osmo-stp_10.42.42.5: Starting osmo-stp 22:18:04.760024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20347): Launched 22:18:05.082925 run osmo-stp_10.42.42.5(pid=20348): Launched 22:18:05.205765 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:18:05.762379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20350): Launched 22:18:05.885701 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:18:06.159266 run patchelf(pid=20351): Launched 22:18:06.339356 run osmo-stp_10.42.42.5(pid=20348): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20348)] 22:18:06.476269 run osmo-stp_10.42.42.5(pid=20348): stdout: | (launched: 2022-12-08_22:18:05.024659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:06.615414 run osmo-stp_10.42.42.5(pid=20348): stderr: | 20221208221805217 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221805217 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221805217 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221805217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221805218 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221805218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221805218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:06.753881 run osmo-stp_10.42.42.5(pid=20348): stdout: | (launched: 2022-12-08_22:18:05.024659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:06.886877 run osmo-stp_10.42.42.5(pid=20348): stderr: | 20221208221805217 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221805217 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221805217 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221805217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221805218 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221805218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221805218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:07.044545 run patchelf(pid=20351): Terminating (SIGINT) 22:18:07.225938 run patchelf(pid=20351): Terminated: ok {rc=0} 22:18:07.356575 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20348): Process ended prematurely: osmo-stp_10.42.42.5(pid=20348) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20348)] [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:18:07.367037 tst iperf3m4.py:8: Test FAILED (10.7 sec) 22:18:07.396018 run osmo-hlr_10.42.42.2(pid=20345): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20345)] 22:18:07.446366 run osmo-hlr_10.42.42.2(pid=20345): stdout: | (launched: 2022-12-08_22:18:04.021280) 22:18:07.498781 run osmo-hlr_10.42.42.2(pid=20345): stderr: | 20221208221804219 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221804219 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221804219 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221804219 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221804219 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221804220 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221804231 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221804239 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221804239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221804240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:18:07.551508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20334): Terminating (SIGTERM) 22:18:07.593767 run iperf3-srv_10.42.42.10(pid=20335): Terminating (SIGTERM) 22:18:07.636149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20336): Terminating (SIGTERM) 22:18:07.678530 run iperf3-srv_10.42.42.10(pid=20337): Terminating (SIGTERM) 22:18:07.720673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20338): Terminating (SIGTERM) 22:18:07.763138 run iperf3-srv_10.42.42.10(pid=20339): Terminating (SIGTERM) 22:18:07.806515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20340): Terminating (SIGTERM) 22:18:07.849007 run iperf3-srv_10.42.42.10(pid=20341): Terminating (SIGTERM) 22:18:07.891169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20344): Terminating (SIGTERM) 22:18:07.933602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20347): Terminating (SIGTERM) 22:18:07.975675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20350): Terminating (SIGTERM) 22:18:08.018116 --- ParallelTerminationStrategy: PID 20334 died... 22:18:08.038127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20334): Terminated: ok {rc=0} 22:18:08.084832 --- ParallelTerminationStrategy: PID 20335 died... 22:18:08.104398 run iperf3-srv_10.42.42.10(pid=20335): Terminated {rc=256} 22:18:08.150701 --- ParallelTerminationStrategy: PID 20336 died... 22:18:08.170496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20336): Terminated: ok {rc=0} 22:18:08.217486 --- ParallelTerminationStrategy: PID 20337 died... 22:18:08.237352 run iperf3-srv_10.42.42.10(pid=20337): Terminated {rc=256} 22:18:08.283761 --- ParallelTerminationStrategy: PID 20338 died... 22:18:08.303456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20338): Terminated: ok {rc=0} 22:18:08.350482 --- ParallelTerminationStrategy: PID 20339 died... 22:18:08.370381 run iperf3-srv_10.42.42.10(pid=20339): Terminated {rc=256} 22:18:08.416908 --- ParallelTerminationStrategy: PID 20340 died... 22:18:08.436555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20340): Terminated: ok {rc=0} 22:18:08.483517 --- ParallelTerminationStrategy: PID 20341 died... 22:18:08.503355 run iperf3-srv_10.42.42.10(pid=20341): Terminated {rc=256} 22:18:08.549802 --- ParallelTerminationStrategy: PID 20344 died... 22:18:08.569934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20344): Terminated: ok {rc=0} 22:18:08.616625 --- ParallelTerminationStrategy: PID 20347 died... 22:18:08.636420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20347): Terminated: ok {rc=0} 22:18:08.683104 --- ParallelTerminationStrategy: PID 20350 died... 22:18:08.703004 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20350): Terminated: ok {rc=0} 22:18:08.791275 bus /gobi_4: Setting Powered False 22:18:09.892016 bus /gobi_4: Setting Powered False 22:18:11.011279 bus /gobi_1: Setting Powered False 22:18:12.111336 bus /gobi_1: Setting Powered False 22:18:13.228315 bus /gobi_0: Setting Powered False 22:18:14.326583 bus /gobi_0: Setting Powered False 22:18:15.445164 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:18:16.550971 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:16.564168 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:18:16.635970 tst ping.py: using LAC 17122 22:18:16.759724 tst ping.py: using RAC 37 22:18:16.921307 tst ping.py: using CellId 17122 22:18:17.074100 tst ping.py: using BVCI 17123 22:18:17.215375 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:17.227200 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:17.239877 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:17.251718 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:17.263670 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:17.275765 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:17.288346 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:17.300283 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:18:17.419005 tst ping.py:19: start network... 22:18:17.631813 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:18:18.121148 run create_hlr_db(pid=20352): Launched 22:18:18.249720 bus /gobi_6: Setting Powered False 22:18:19.313408 run create_hlr_db(pid=20352): Terminated: ok {rc=0} 22:18:19.755277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20354): Launched 22:18:20.072043 run osmo-hlr_10.42.42.2(pid=20355): Launched 22:18:20.192297 run osmo-stp_10.42.42.5: Starting osmo-stp 22:18:20.743565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20357): Launched 22:18:21.060095 run osmo-stp_10.42.42.5(pid=20358): Launched 22:18:21.180362 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:18:21.727602 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20360): Launched 22:18:21.849614 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:18:22.119840 run patchelf(pid=20361): Launched 22:18:22.297107 run osmo-stp_10.42.42.5(pid=20358): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20358)] 22:18:22.432504 run osmo-stp_10.42.42.5(pid=20358): stdout: | (launched: 2022-12-08_22:18:21.002973) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:22.569191 run osmo-stp_10.42.42.5(pid=20358): stderr: | 20221208221821194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221821194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221821195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221821195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221821195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221821195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221821196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:22.706430 run osmo-stp_10.42.42.5(pid=20358): stdout: | (launched: 2022-12-08_22:18:21.002973) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:22.837102 run osmo-stp_10.42.42.5(pid=20358): stderr: | 20221208221821194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221821194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221821195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221821195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221821195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221821195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221821196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:22.992159 run patchelf(pid=20361): Terminating (SIGINT) 22:18:23.171084 run patchelf(pid=20361): Terminated: ok {rc=0} 22:18:23.299825 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20358): Process ended prematurely: osmo-stp_10.42.42.5(pid=20358) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20358)] [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 22:18:23.309497 tst ping.py:22: Test FAILED (6.8 sec) 22:18:23.338063 run osmo-hlr_10.42.42.2(pid=20355): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20355)] 22:18:23.389513 run osmo-hlr_10.42.42.2(pid=20355): stdout: | (launched: 2022-12-08_22:18:20.014961) 22:18:23.442442 run osmo-hlr_10.42.42.2(pid=20355): stderr: | 20221208221820214 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221820214 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221820214 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221820214 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221820214 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221820214 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221820227 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221820237 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221820237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221820237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:18:23.495741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20354): Terminating (SIGTERM) 22:18:23.538484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20357): Terminating (SIGTERM) 22:18:23.581504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20360): Terminating (SIGTERM) 22:18:23.624436 --- ParallelTerminationStrategy: PID 20354 died... 22:18:23.644759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20354): Terminated: ok {rc=0} 22:18:23.692088 --- ParallelTerminationStrategy: PID 20357 died... 22:18:23.712510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20357): Terminated: ok {rc=0} 22:18:23.759909 --- ParallelTerminationStrategy: PID 20360 died... 22:18:23.779899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20360): Terminated: ok {rc=0} 22:18:23.868800 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:18:24.956420 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:24.968641 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:18:25.041474 tst ping_idle_ping.py: using LAC 17123 22:18:25.167453 tst ping_idle_ping.py: using RAC 38 22:18:25.292351 tst ping_idle_ping.py: using CellId 17123 22:18:25.419850 tst ping_idle_ping.py: using BVCI 17124 22:18:25.537296 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:25.548787 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:25.560083 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:25.571323 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:25.582522 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:25.593844 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:25.605171 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:25.616343 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:18:25.734113 tst ping_idle_ping.py:24: start network... 22:18:25.948798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:18:26.448312 run create_hlr_db(pid=20362): Launched 22:18:26.577806 bus /gobi_6: Setting Powered False 22:18:27.641895 run create_hlr_db(pid=20362): Terminated: ok {rc=0} 22:18:28.087565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20364): Launched 22:18:28.404603 run osmo-hlr_10.42.42.2(pid=20365): Launched 22:18:28.525714 run osmo-stp_10.42.42.5: Starting osmo-stp 22:18:29.078978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20367): Launched 22:18:29.395985 run osmo-stp_10.42.42.5(pid=20368): Launched 22:18:29.516895 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:18:30.065363 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20370): Launched 22:18:30.186942 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:18:30.454903 run patchelf(pid=20371): Launched 22:18:30.632313 run osmo-stp_10.42.42.5(pid=20368): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20368)] 22:18:30.768642 run osmo-stp_10.42.42.5(pid=20368): stdout: | (launched: 2022-12-08_22:18:29.338796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:30.936257 run osmo-stp_10.42.42.5(pid=20368): stderr: | 20221208221829528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221829528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221829529 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221829529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221829530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221829530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221829530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:31.077805 run osmo-stp_10.42.42.5(pid=20368): stdout: | (launched: 2022-12-08_22:18:29.338796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:31.227743 run osmo-stp_10.42.42.5(pid=20368): stderr: | 20221208221829528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221829528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221829529 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221829529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221829530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221829530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221829530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:31.404615 run patchelf(pid=20371): Terminating (SIGINT) 22:18:31.587649 run patchelf(pid=20371): Terminated: ok {rc=0} 22:18:31.719527 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20368): Process ended prematurely: osmo-stp_10.42.42.5(pid=20368) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20368)] [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:18:31.729921 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 22:18:31.759948 run osmo-hlr_10.42.42.2(pid=20365): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20365)] 22:18:31.812498 run osmo-hlr_10.42.42.2(pid=20365): stdout: | (launched: 2022-12-08_22:18:28.347592) 22:18:31.866593 run osmo-hlr_10.42.42.2(pid=20365): stderr: | 20221208221828544 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221828544 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221828544 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221828544 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221828544 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221828544 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221828557 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221828566 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221828566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221828566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:18:31.921493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20364): Terminating (SIGTERM) 22:18:31.965300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20367): Terminating (SIGTERM) 22:18:32.009424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20370): Terminating (SIGTERM) 22:18:32.054309 --- ParallelTerminationStrategy: PID 20364 died... 22:18:32.074825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20364): Terminated: ok {rc=0} 22:18:32.122598 --- ParallelTerminationStrategy: PID 20367 died... 22:18:32.142753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20367): Terminated: ok {rc=0} 22:18:32.190109 --- ParallelTerminationStrategy: PID 20370 died... 22:18:32.209816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20370): Terminated: ok {rc=0} 22:18:32.298134 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:18:33.601559 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:18:33.607612 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:18:33.641141 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 22:18:33.679139 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 22:18:33.770248 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:18:33.803712 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 22:18:33.841653 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 22:18:34.432293 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 22:18:34.482771 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:34.493689 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:18:34.564738 tst cs_paging_gprs_active.py: using LAC 17124 22:18:34.692295 tst cs_paging_gprs_active.py: using RAC 39 22:18:34.819374 tst cs_paging_gprs_active.py: using CellId 17124 22:18:34.938308 tst cs_paging_gprs_active.py: using BVCI 17125 22:18:35.049631 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:35.060444 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:35.071248 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:35.082280 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:35.093424 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:35.104190 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:35.115248 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:35.126252 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:35.137384 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:18:35.257545 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:18:35.376761 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:18:35.594660 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:18:35.919552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20375): Launched 22:18:36.201737 run iperf3-srv_10.42.42.10(pid=20376): Launched 22:18:36.323549 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:18:36.542899 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:18:36.869748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20377): Launched 22:18:37.152632 run iperf3-srv_10.42.42.10(pid=20378): Launched 22:18:37.274778 tst cs_paging_gprs_active.py:38: start network... 22:18:37.493469 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:18:37.995930 run create_hlr_db(pid=20379): Launched 22:18:38.127278 bus /gobi_6: Setting Powered False 22:18:39.191183 run create_hlr_db(pid=20379): Terminated: ok {rc=0} 22:18:39.622349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20381): Launched 22:18:39.925174 run osmo-hlr_10.42.42.2(pid=20382): Launched 22:18:40.040918 run osmo-stp_10.42.42.5: Starting osmo-stp 22:18:40.563576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20384): Launched 22:18:40.867127 run osmo-stp_10.42.42.5(pid=20385): Launched 22:18:40.982857 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:18:41.505725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20387): Launched 22:18:41.621693 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:18:41.877849 run patchelf(pid=20388): Launched 22:18:42.047785 run osmo-stp_10.42.42.5(pid=20385): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20385)] 22:18:42.177315 run osmo-stp_10.42.42.5(pid=20385): stdout: | (launched: 2022-12-08_22:18:40.812299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:42.308345 run osmo-stp_10.42.42.5(pid=20385): stderr: | 20221208221840982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221840983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221840983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221840983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221840984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221840984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221840984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:42.440061 run osmo-stp_10.42.42.5(pid=20385): stdout: | (launched: 2022-12-08_22:18:40.812299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:42.566337 run osmo-stp_10.42.42.5(pid=20385): stderr: | 20221208221840982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221840983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221840983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221840983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221840984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221840984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221840984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:42.716180 run patchelf(pid=20388): Terminating (SIGINT) 22:18:42.888830 run patchelf(pid=20388): Terminated: ok {rc=0} 22:18:43.013160 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20385): Process ended prematurely: osmo-stp_10.42.42.5(pid=20385) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20385)] [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 22:18:43.022659 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 22:18:43.050702 run osmo-hlr_10.42.42.2(pid=20382): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20382)] 22:18:43.099599 run osmo-hlr_10.42.42.2(pid=20382): stdout: | (launched: 2022-12-08_22:18:39.870383) 22:18:43.150150 run osmo-hlr_10.42.42.2(pid=20382): stderr: | 20221208221840047 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221840047 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221840047 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221840047 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221840047 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221840048 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221840060 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221840068 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221840068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221840069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:18:43.201183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20375): Terminating (SIGTERM) 22:18:43.241945 run iperf3-srv_10.42.42.10(pid=20376): Terminating (SIGTERM) 22:18:43.282456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20377): Terminating (SIGTERM) 22:18:43.323168 run iperf3-srv_10.42.42.10(pid=20378): Terminating (SIGTERM) 22:18:43.363649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20381): Terminating (SIGTERM) 22:18:43.404152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20384): Terminating (SIGTERM) 22:18:43.444712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20387): Terminating (SIGTERM) 22:18:43.485396 --- ParallelTerminationStrategy: PID 20375 died... 22:18:43.504430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20375): Terminated: ok {rc=0} 22:18:43.549636 --- ParallelTerminationStrategy: PID 20376 died... 22:18:43.568401 run iperf3-srv_10.42.42.10(pid=20376): Terminated {rc=256} 22:18:43.613231 --- ParallelTerminationStrategy: PID 20377 died... 22:18:43.631933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20377): Terminated: ok {rc=0} 22:18:43.676869 --- ParallelTerminationStrategy: PID 20378 died... 22:18:43.695921 run iperf3-srv_10.42.42.10(pid=20378): Terminated {rc=256} 22:18:43.740787 --- ParallelTerminationStrategy: PID 20381 died... 22:18:43.759476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20381): Terminated: ok {rc=0} 22:18:43.804446 --- ParallelTerminationStrategy: PID 20384 died... 22:18:43.823324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20384): Terminated: ok {rc=0} 22:18:43.868216 --- ParallelTerminationStrategy: PID 20387 died... 22:18:43.887348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20387): Terminated: ok {rc=0} 22:18:43.974603 bus /gobi_0: Setting Powered False 22:18:45.074788 bus /gobi_0: Setting Powered False 22:18:46.194592 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 22:18:47.358659 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:47.370856 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:18:47.446701 tst iperf3.py: using LAC 17125 22:18:47.574678 tst iperf3.py: using RAC 40 22:18:47.701029 tst iperf3.py: using CellId 17125 22:18:47.827745 tst iperf3.py: using BVCI 17126 22:18:47.945593 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:47.956903 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:47.968647 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:47.980032 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:47.991406 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:48.002814 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:48.014285 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:48.025654 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:48.037129 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:18:48.151960 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:18:48.355126 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:18:48.659073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20389): Launched 22:18:48.923882 run iperf3-srv_10.42.42.10(pid=20390): Launched 22:18:49.037952 tst iperf3.py:8: start network... 22:18:49.240617 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:18:49.710071 run create_hlr_db(pid=20391): Launched 22:18:49.826027 bus /gobi_6: Setting Powered False 22:18:50.886131 run create_hlr_db(pid=20391): Terminated: ok {rc=0} 22:18:51.327878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20393): Launched 22:18:51.649910 run osmo-hlr_10.42.42.2(pid=20394): Launched 22:18:51.774704 run osmo-stp_10.42.42.5: Starting osmo-stp 22:18:52.337317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20396): Launched 22:18:52.660013 run osmo-stp_10.42.42.5(pid=20397): Launched 22:18:52.785867 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:18:53.345092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20400): Launched 22:18:53.468327 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:18:53.741984 run patchelf(pid=20401): Launched 22:18:53.921725 run osmo-stp_10.42.42.5(pid=20397): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20397)] 22:18:54.059531 run osmo-stp_10.42.42.5(pid=20397): stdout: | (launched: 2022-12-08_22:18:52.601812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:54.198843 run osmo-stp_10.42.42.5(pid=20397): stderr: | 20221208221852794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221852794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221852794 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221852795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221852797 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221852797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221852797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:54.337733 run osmo-stp_10.42.42.5(pid=20397): stdout: | (launched: 2022-12-08_22:18:52.601812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:54.471369 run osmo-stp_10.42.42.5(pid=20397): stderr: | 20221208221852794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221852794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221852794 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221852795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221852797 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221852797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221852797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:54.629368 run patchelf(pid=20401): Terminating (SIGINT) 22:18:54.811323 run patchelf(pid=20401): Terminated: ok {rc=0} 22:18:54.942841 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20397): Process ended prematurely: osmo-stp_10.42.42.5(pid=20397) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20397)] [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 22:18:54.953555 tst iperf3.py:8: Test FAILED (7.6 sec) 22:18:54.982460 run osmo-hlr_10.42.42.2(pid=20394): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20394)] 22:18:55.033575 run osmo-hlr_10.42.42.2(pid=20394): stdout: | (launched: 2022-12-08_22:18:51.592042) 22:18:55.086006 run osmo-hlr_10.42.42.2(pid=20394): stderr: | 20221208221851789 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221851789 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221851789 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221851789 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221851789 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221851789 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221851802 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221851810 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221851810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221851811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:18:55.138929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20389): Terminating (SIGTERM) 22:18:55.181326 run iperf3-srv_10.42.42.10(pid=20390): Terminating (SIGTERM) 22:18:55.223544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20393): Terminating (SIGTERM) 22:18:55.265960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20396): Terminating (SIGTERM) 22:18:55.308422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20400): Terminating (SIGTERM) 22:18:55.351116 --- ParallelTerminationStrategy: PID 20389 died... 22:18:55.371325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20389): Terminated: ok {rc=0} 22:18:55.418356 --- ParallelTerminationStrategy: PID 20390 died... 22:18:55.438139 run iperf3-srv_10.42.42.10(pid=20390): Terminated {rc=256} 22:18:55.484857 --- ParallelTerminationStrategy: PID 20393 died... 22:18:55.505022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20393): Terminated: ok {rc=0} 22:18:55.552167 --- ParallelTerminationStrategy: PID 20396 died... 22:18:55.572196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20396): Terminated: ok {rc=0} 22:18:55.619115 --- ParallelTerminationStrategy: PID 20400 died... 22:18:55.639004 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20400): Terminated: ok {rc=0} 22:18:55.726325 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 22:18:56.873426 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:56.884802 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:18:56.955638 tst iperf3m4.py: using LAC 17126 22:18:57.076770 tst iperf3m4.py: using RAC 41 22:18:57.208235 tst iperf3m4.py: using CellId 17126 22:18:57.335889 tst iperf3m4.py: using BVCI 17127 22:18:57.455533 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:57.467086 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:57.478455 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:57.490460 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:57.502422 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:57.514208 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:57.526110 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:57.537832 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:57.549810 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:18:57.665325 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:18:57.782169 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:18:57.901661 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:18:58.017157 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:18:58.220852 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:18:58.524394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20402): Launched 22:18:58.788007 run iperf3-srv_10.42.42.10(pid=20403): Launched 22:18:58.902149 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:18:59.106089 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:18:59.410534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20404): Launched 22:18:59.672872 run iperf3-srv_10.42.42.10(pid=20405): Launched 22:18:59.786549 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:18:59.989763 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:19:00.293079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20406): Launched 22:19:00.555786 run iperf3-srv_10.42.42.10(pid=20407): Launched 22:19:00.670341 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:19:00.888201 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:19:01.229753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20408): Launched 22:19:01.522384 run iperf3-srv_10.42.42.10(pid=20409): Launched 22:19:01.659760 tst iperf3m4.py:8: start network... 22:19:01.886085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:19:02.401381 run create_hlr_db(pid=20410): Launched 22:19:02.532477 bus /gobi_6: Setting Powered False 22:19:03.596490 run create_hlr_db(pid=20410): Terminated: ok {rc=0} 22:19:04.027769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20412): Launched 22:19:04.330346 run osmo-hlr_10.42.42.2(pid=20413): Launched 22:19:04.449115 run osmo-stp_10.42.42.5: Starting osmo-stp 22:19:04.972393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20415): Launched 22:19:05.274702 run osmo-stp_10.42.42.5(pid=20416): Launched 22:19:05.390755 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:19:05.911912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20418): Launched 22:19:06.027400 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:19:06.282937 run patchelf(pid=20419): Launched 22:19:06.451525 run osmo-stp_10.42.42.5(pid=20416): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20416)] 22:19:06.580084 run osmo-stp_10.42.42.5(pid=20416): stdout: | (launched: 2022-12-08_22:19:05.219996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:06.710111 run osmo-stp_10.42.42.5(pid=20416): stderr: | 20221208221905391 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221905391 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221905391 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221905392 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221905392 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221905392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221905392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:06.840261 run osmo-stp_10.42.42.5(pid=20416): stdout: | (launched: 2022-12-08_22:19:05.219996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:06.965425 run osmo-stp_10.42.42.5(pid=20416): stderr: | 20221208221905391 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221905391 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221905391 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221905392 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221905392 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221905392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221905392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:07.113917 run patchelf(pid=20419): Terminating (SIGINT) 22:19:07.284755 run patchelf(pid=20419): Terminated: ok {rc=0} 22:19:07.407552 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20416): Process ended prematurely: osmo-stp_10.42.42.5(pid=20416) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20416)] [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 22:19:07.417337 tst iperf3m4.py:8: Test FAILED (10.6 sec) 22:19:07.445706 run osmo-hlr_10.42.42.2(pid=20413): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20413)] 22:19:07.495583 run osmo-hlr_10.42.42.2(pid=20413): stdout: | (launched: 2022-12-08_22:19:04.275657) 22:19:07.546224 run osmo-hlr_10.42.42.2(pid=20413): stderr: | 20221208221904452 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221904452 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221904452 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221904452 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221904452 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221904452 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221904464 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221904473 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221904473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221904473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:19:07.596984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20402): Terminating (SIGTERM) 22:19:07.637596 run iperf3-srv_10.42.42.10(pid=20403): Terminating (SIGTERM) 22:19:07.677828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20404): Terminating (SIGTERM) 22:19:07.718215 run iperf3-srv_10.42.42.10(pid=20405): Terminating (SIGTERM) 22:19:07.758507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20406): Terminating (SIGTERM) 22:19:07.798745 run iperf3-srv_10.42.42.10(pid=20407): Terminating (SIGTERM) 22:19:07.838952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20408): Terminating (SIGTERM) 22:19:07.879223 run iperf3-srv_10.42.42.10(pid=20409): Terminating (SIGTERM) 22:19:07.919265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20412): Terminating (SIGTERM) 22:19:07.959648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20415): Terminating (SIGTERM) 22:19:07.999977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20418): Terminating (SIGTERM) 22:19:08.040471 --- ParallelTerminationStrategy: PID 20402 died... 22:19:08.059715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20402): Terminated: ok {rc=0} 22:19:08.105463 --- ParallelTerminationStrategy: PID 20403 died... 22:19:08.124082 run iperf3-srv_10.42.42.10(pid=20403): Terminated {rc=256} 22:19:08.169166 --- ParallelTerminationStrategy: PID 20404 died... 22:19:08.187969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20404): Terminated: ok {rc=0} 22:19:08.233400 --- ParallelTerminationStrategy: PID 20405 died... 22:19:08.252355 run iperf3-srv_10.42.42.10(pid=20405): Terminated {rc=256} 22:19:08.297549 --- ParallelTerminationStrategy: PID 20406 died... 22:19:08.316423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20406): Terminated: ok {rc=0} 22:19:08.361759 --- ParallelTerminationStrategy: PID 20407 died... 22:19:08.380567 run iperf3-srv_10.42.42.10(pid=20407): Terminated {rc=256} 22:19:08.425971 --- ParallelTerminationStrategy: PID 20408 died... 22:19:08.445043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20408): Terminated: ok {rc=0} 22:19:08.490653 --- ParallelTerminationStrategy: PID 20409 died... 22:19:08.509532 run iperf3-srv_10.42.42.10(pid=20409): Terminated {rc=256} 22:19:08.554754 --- ParallelTerminationStrategy: PID 20412 died... 22:19:08.573752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20412): Terminated: ok {rc=0} 22:19:08.619089 --- ParallelTerminationStrategy: PID 20415 died... 22:19:08.638069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20415): Terminated: ok {rc=0} 22:19:08.683449 --- ParallelTerminationStrategy: PID 20418 died... 22:19:08.702424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20418): Terminated: ok {rc=0} 22:19:08.788648 bus /gobi_4: Setting Powered False 22:19:09.888261 bus /gobi_4: Setting Powered False 22:19:11.006466 bus /gobi_1: Setting Powered False 22:19:12.103231 bus /gobi_1: Setting Powered False 22:19:13.219364 bus /gobi_0: Setting Powered False 22:19:14.318217 bus /gobi_0: Setting Powered False 22:19:15.436009 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 22:19:16.553715 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:16.573406 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:19:16.667430 tst ping.py: using LAC 17127 22:19:16.790194 tst ping.py: using RAC 42 22:19:16.920714 tst ping.py: using CellId 17127 22:19:17.047760 tst ping.py: using BVCI 17128 22:19:17.166546 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:17.178507 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:17.190250 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:17.202131 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:17.214079 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:17.226102 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:17.238083 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:17.249907 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:19:17.363721 tst ping.py:19: start network... 22:19:17.562409 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:19:18.020170 run create_hlr_db(pid=20420): Launched 22:19:18.134752 bus /gobi_6: Setting Powered False 22:19:19.195029 run create_hlr_db(pid=20420): Terminated: ok {rc=0} 22:19:19.629602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20422): Launched 22:19:19.947128 run osmo-hlr_10.42.42.2(pid=20423): Launched 22:19:20.069287 run osmo-stp_10.42.42.5: Starting osmo-stp 22:19:20.623140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20425): Launched 22:19:20.939135 run osmo-stp_10.42.42.5(pid=20426): Launched 22:19:21.060693 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:19:21.611169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20428): Launched 22:19:21.732903 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:19:22.001889 run patchelf(pid=20429): Launched 22:19:22.178825 run osmo-stp_10.42.42.5(pid=20426): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20426)] 22:19:22.314489 run osmo-stp_10.42.42.5(pid=20426): stdout: | (launched: 2022-12-08_22:19:20.881997) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:22.451821 run osmo-stp_10.42.42.5(pid=20426): stderr: | 20221208221921071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221921071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221921071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221921072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221921074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221921074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221921074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:22.589088 run osmo-stp_10.42.42.5(pid=20426): stdout: | (launched: 2022-12-08_22:19:20.881997) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:22.720352 run osmo-stp_10.42.42.5(pid=20426): stderr: | 20221208221921071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221921071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221921071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221921072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221921074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221921074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221921074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:22.875570 run patchelf(pid=20429): Terminating (SIGINT) 22:19:23.055536 run patchelf(pid=20429): Terminated: ok {rc=0} 22:19:23.185973 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20426): Process ended prematurely: osmo-stp_10.42.42.5(pid=20426) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20426)] [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 22:19:23.195398 tst ping.py:22: Test FAILED (6.6 sec) 22:19:23.224075 run osmo-hlr_10.42.42.2(pid=20423): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20423)] 22:19:23.275618 run osmo-hlr_10.42.42.2(pid=20423): stdout: | (launched: 2022-12-08_22:19:19.889832) 22:19:23.329309 run osmo-hlr_10.42.42.2(pid=20423): stderr: | 20221208221920086 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221920086 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221920086 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221920086 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221920086 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221920086 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221920098 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221920106 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221920107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221920107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:19:23.383000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20422): Terminating (SIGTERM) 22:19:23.425729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20425): Terminating (SIGTERM) 22:19:23.469061 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20428): Terminating (SIGTERM) 22:19:23.512099 --- ParallelTerminationStrategy: PID 20422 died... 22:19:23.532566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20422): Terminated: ok {rc=0} 22:19:23.579954 --- ParallelTerminationStrategy: PID 20425 died... 22:19:23.599886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20425): Terminated: ok {rc=0} 22:19:23.647353 --- ParallelTerminationStrategy: PID 20428 died... 22:19:23.667210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20428): Terminated: ok {rc=0} 22:19:23.755703 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 22:19:24.844003 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:24.856381 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:19:24.928143 tst ping_idle_ping.py: using LAC 17128 22:19:25.047949 tst ping_idle_ping.py: using RAC 43 22:19:25.167755 tst ping_idle_ping.py: using CellId 17128 22:19:25.292369 tst ping_idle_ping.py: using BVCI 17129 22:19:25.407804 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:25.419184 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:25.430447 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:25.441803 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:25.452843 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:25.464128 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:25.475385 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:25.486704 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:19:25.601503 tst ping_idle_ping.py:24: start network... 22:19:25.801759 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:19:26.266530 run create_hlr_db(pid=20430): Launched 22:19:26.380870 bus /gobi_6: Setting Powered False 22:19:27.444733 run create_hlr_db(pid=20430): Terminated: ok {rc=0} 22:19:27.873584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20432): Launched 22:19:28.172464 run osmo-hlr_10.42.42.2(pid=20433): Launched 22:19:28.286646 run osmo-stp_10.42.42.5: Starting osmo-stp 22:19:28.813282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20435): Launched 22:19:29.111193 run osmo-stp_10.42.42.5(pid=20436): Launched 22:19:29.225924 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:19:29.742251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20438): Launched 22:19:29.857386 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:19:30.110802 run patchelf(pid=20439): Launched 22:19:30.277913 run osmo-stp_10.42.42.5(pid=20436): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20436)] 22:19:30.406058 run osmo-stp_10.42.42.5(pid=20436): stdout: | (launched: 2022-12-08_22:19:29.057415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:30.535283 run osmo-stp_10.42.42.5(pid=20436): stderr: | 20221208221929227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221929227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221929227 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221929227 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221929230 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221929230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221929230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:30.664624 run osmo-stp_10.42.42.5(pid=20436): stdout: | (launched: 2022-12-08_22:19:29.057415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:30.788322 run osmo-stp_10.42.42.5(pid=20436): stderr: | 20221208221929227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221929227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221929227 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221929227 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221929230 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221929230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221929230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:30.988932 run patchelf(pid=20439): Terminating (SIGINT) 22:19:31.164353 run patchelf(pid=20439): Terminated: ok {rc=0} 22:19:31.291695 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20436): Process ended prematurely: osmo-stp_10.42.42.5(pid=20436) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20436)] [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 22:19:31.301892 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:19:31.332565 run osmo-hlr_10.42.42.2(pid=20433): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20433)] 22:19:31.384401 run osmo-hlr_10.42.42.2(pid=20433): stdout: | (launched: 2022-12-08_22:19:28.118414) 22:19:31.437523 run osmo-hlr_10.42.42.2(pid=20433): stderr: | 20221208221928294 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221928294 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221928294 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221928294 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221928294 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221928294 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221928307 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221928315 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221928315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221928316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:19:31.491177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20432): Terminating (SIGTERM) 22:19:31.534579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20435): Terminating (SIGTERM) 22:19:31.577719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20438): Terminating (SIGTERM) 22:19:31.621862 --- ParallelTerminationStrategy: PID 20432 died... 22:19:31.642049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20432): Terminated: ok {rc=0} 22:19:31.691955 --- ParallelTerminationStrategy: PID 20435 died... 22:19:31.712173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20435): Terminated: ok {rc=0} 22:19:31.760839 --- ParallelTerminationStrategy: PID 20438 died... 22:19:31.780882 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20438): Terminated: ok {rc=0} 22:19:31.871714 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:19:33.175549 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:19:33.183577 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:19:33.217777 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:19:33.253592 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:19:33.311283 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:19:33.345688 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:19:33.380538 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:19:33.936406 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2350 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:19:33.941573 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:19:33.953231 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:19:34.026284 tst switch_tch_pdch.py: using LAC 17129 22:19:34.150647 tst switch_tch_pdch.py: using RAC 44 22:19:34.276438 tst switch_tch_pdch.py: using CellId 17129 22:19:34.398774 tst switch_tch_pdch.py: using BVCI 17130 22:19:34.515553 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:19:34.527240 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:19:34.538712 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:19:34.550186 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:19:34.561849 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:19:34.573288 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:19:34.584831 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:19:34.596326 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:19:34.715478 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:19:34.829987 tst switch_tch_pdch.py:51: start network... 22:19:35.028324 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:19:35.488865 run create_hlr_db(pid=20444): Launched 22:19:35.603664 bus /gobi_6: Setting Powered False 22:19:36.663193 run create_hlr_db(pid=20444): Terminated: ok {rc=0} 22:19:37.099493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20446): Launched 22:19:37.417878 run osmo-hlr_10.42.42.2(pid=20447): Launched 22:19:37.538512 run osmo-stp_10.42.42.5: Starting osmo-stp 22:19:38.090640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20449): Launched 22:19:38.406370 run osmo-stp_10.42.42.5(pid=20450): Launched 22:19:38.526821 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:19:39.075398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20452): Launched 22:19:39.196624 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:19:39.464726 run patchelf(pid=20453): Launched 22:19:39.641622 run osmo-stp_10.42.42.5(pid=20450): ERR: Terminated: ERROR {rc=1} [trial-2350↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20450)] 22:19:39.776504 run osmo-stp_10.42.42.5(pid=20450): stdout: | (launched: 2022-12-08_22:19:38.349518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:39.913042 run osmo-stp_10.42.42.5(pid=20450): stderr: | 20221208221938538 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221938538 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221938538 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221938539 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221938539 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221938539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221938539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:40.051391 run osmo-stp_10.42.42.5(pid=20450): stdout: | (launched: 2022-12-08_22:19:38.349518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:40.181383 run osmo-stp_10.42.42.5(pid=20450): stderr: | 20221208221938538 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221938538 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221938538 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221938539 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221938539 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221938539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221938539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:40.335620 run patchelf(pid=20453): Terminating (SIGINT) 22:19:40.513898 run patchelf(pid=20453): Terminated: ok {rc=0} 22:19:40.642301 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20450): Process ended prematurely: osmo-stp_10.42.42.5(pid=20450) [trial-2350↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20450)] [trial-2350↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:19:40.651860 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 22:19:40.679962 run osmo-hlr_10.42.42.2(pid=20447): ERR: Terminated: ERROR {rc=237} [trial-2350↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20447)] 22:19:40.730603 run osmo-hlr_10.42.42.2(pid=20447): stdout: | (launched: 2022-12-08_22:19:37.360683) 22:19:40.782957 run osmo-hlr_10.42.42.2(pid=20447): stderr: | 20221208221937559 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221937559 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221937559 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221937559 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221937559 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221937560 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221937573 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221937582 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221937583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221937583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:19:40.835781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20446): Terminating (SIGTERM) 22:19:40.878111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20449): Terminating (SIGTERM) 22:19:40.920399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20452): Terminating (SIGTERM) 22:19:40.962915 --- ParallelTerminationStrategy: PID 20446 died... 22:19:40.983295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20446): Terminated: ok {rc=0} 22:19:41.030010 --- ParallelTerminationStrategy: PID 20449 died... 22:19:41.049678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20449): Terminated: ok {rc=0} 22:19:41.096337 --- ParallelTerminationStrategy: PID 20452 died... 22:19:41.116145 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20452): Terminated: ok {rc=0} 22:19:41.204306 bus /gobi_0: Setting Powered False 22:19:42.304033 bus /gobi_0: Setting Powered False 22:19:43.418963 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 22:19:44.671990 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:19:44.677781 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 22:19:44.711506 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 22:19:44.745406 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 22:19:44.798782 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 22:19:44.832386 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 22:19:44.866355 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 22:19:45.420543 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2350 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 22:19:45.425520 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:19:45.436331 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 22:19:45.505662 tst switch_tch_pdch.py: using LAC 17130 22:19:45.631772 tst switch_tch_pdch.py: using RAC 45 22:19:45.763014 tst switch_tch_pdch.py: using CellId 17130 22:19:45.904344 tst switch_tch_pdch.py: using BVCI 17131 22:19:46.017051 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:19:46.028926 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:19:46.040741 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:19:46.053440 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:19:46.066363 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:19:46.079097 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:19:46.092322 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:19:46.105073 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:19:46.240767 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:19:46.356732 tst switch_tch_pdch.py:51: start network... 22:19:46.563430 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:19:47.016579 run create_hlr_db(pid=20457): Launched 22:19:47.178764 bus /gobi_6: Setting Powered False 22:19:48.243093 run create_hlr_db(pid=20457): Terminated: ok {rc=0} 22:19:48.659502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20459): Launched 22:19:48.976790 run osmo-hlr_10.42.42.2(pid=20460): Launched 22:19:49.097472 run osmo-stp_10.42.42.5: Starting osmo-stp 22:19:49.620443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20462): Launched 22:19:49.935819 run osmo-stp_10.42.42.5(pid=20463): Launched 22:19:50.056444 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:19:50.575791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20465): Launched 22:19:50.696901 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:19:50.965848 run patchelf(pid=20466): Launched 22:19:51.143337 run osmo-stp_10.42.42.5(pid=20463): ERR: Terminated: ERROR {rc=1} [trial-2350↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20463)] 22:19:51.279418 run osmo-stp_10.42.42.5(pid=20463): stdout: | (launched: 2022-12-08_22:19:49.878862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:51.417379 run osmo-stp_10.42.42.5(pid=20463): stderr: | 20221208221950070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221950070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221950070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221950070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221950073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221950073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221950073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:51.554463 run osmo-stp_10.42.42.5(pid=20463): stdout: | (launched: 2022-12-08_22:19:49.878862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:51.685401 run osmo-stp_10.42.42.5(pid=20463): stderr: | 20221208221950070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208221950070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208221950070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208221950070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208221950073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208221950073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208221950073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:51.840889 run patchelf(pid=20466): Terminating (SIGINT) 22:19:52.021555 run patchelf(pid=20466): Terminated: ok {rc=0} 22:19:52.151006 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20463): Process ended prematurely: osmo-stp_10.42.42.5(pid=20463) [trial-2350↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20463)] [trial-2350↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 22:19:52.160504 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 22:19:52.188693 run osmo-hlr_10.42.42.2(pid=20460): ERR: Terminated: ERROR {rc=237} [trial-2350↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20460)] 22:19:52.239494 run osmo-hlr_10.42.42.2(pid=20460): stdout: | (launched: 2022-12-08_22:19:48.919633) 22:19:52.291790 run osmo-hlr_10.42.42.2(pid=20460): stderr: | 20221208221949117 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208221949117 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208221949117 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208221949118 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208221949118 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208221949118 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208221949131 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208221949140 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208221949141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208221949141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:19:52.344270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20459): Terminating (SIGTERM) 22:19:52.386486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20462): Terminating (SIGTERM) 22:19:52.428649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20465): Terminating (SIGTERM) 22:19:52.471669 --- ParallelTerminationStrategy: PID 20459 died... 22:19:52.491826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20459): Terminated: ok {rc=0} 22:19:52.538872 --- ParallelTerminationStrategy: PID 20462 died... 22:19:52.558491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20462): Terminated: ok {rc=0} 22:19:52.604935 --- ParallelTerminationStrategy: PID 20465 died... 22:19:52.624608 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20465): Terminated: ok {rc=0} 22:19:52.711672 bus /gobi_0: Setting Powered False 22:19:53.810268 bus /gobi_0: Setting Powered False 22:19:54.926937 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 nitb_sms:trx-umtrx --------------------------------------------------------------------- 22:19:56.185133 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:19:56.189104 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 22:19:56.221801 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 22:19:56.228692 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 22:19:56.282131 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 22:19:56.315088 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 22:19:56.321946 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 22:19:56.859242 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 22:19:56.864198 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 22:19:56.875267 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 22:19:56.922328 tst mo_mt_sms.py: using LAC 17131 22:19:57.049144 tst mo_mt_sms.py: using RAC 46 22:19:57.175161 tst mo_mt_sms.py: using CellId 17131 22:19:57.301080 tst mo_mt_sms.py: using BVCI 17132 22:19:57.415686 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 22:19:57.529922 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 22:19:57.641405 tst mo_mt_sms.py:9: start nitb and bts... 22:19:57.841065 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:19:58.445276 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20471): Launched 22:19:58.742582 run osmo-nitb_10.42.42.2(pid=20472): Launched 22:19:58.908098 run osmo-nitb_10.42.42.2(pid=20472): ERR: Terminated: ERROR {rc=2} [trial-2350↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20472)] 22:19:59.042831 run osmo-nitb_10.42.42.2(pid=20472): stdout: | (launched: 2022-12-08_22:19:58.688557) 22:19:59.179286 run osmo-nitb_10.42.42.2(pid=20472): stderr: | (launched: 2022-12-08_22:19:58.733163) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:19:59.315328 run osmo-nitb_10.42.42.2(pid=20472): stdout: | (launched: 2022-12-08_22:19:58.688557) 22:19:59.446407 run osmo-nitb_10.42.42.2(pid=20472): stderr: | (launched: 2022-12-08_22:19:58.733163) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3c9519268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20472): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20472) [trial-2350↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20472)] 22:19:59.855266 tst osmo-nitb_10.42.42.2(pid=20472): stdout: | (launched: 2022-12-08_22:19:58.688557) 22:19:59.975841 tst osmo-nitb_10.42.42.2(pid=20472): stderr: | (launched: 2022-12-08_22:19:58.733163) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:20:00.118222 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=20472): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20472) [trial-2350↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20472)] [trial-2350↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 22:20:00.126709 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 22:20:00.133234 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20471): Terminating (SIGTERM) 22:20:00.342999 --- ParallelTerminationStrategy: PID 20471 died... 22:20:00.363896 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20471): Terminated: ok {rc=0} 22:20:00.451309 bus /sierra_3: Setting Powered False 22:20:01.576152 bus /sierra_3: Setting Powered False 22:20:02.724365 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 sms:trx-umtrx --------------------------------------------------------------------- 22:20:03.924572 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:20:03.929211 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 22:20:03.962009 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 22:20:03.989489 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 22:20:04.042198 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 22:20:04.075417 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 22:20:04.102361 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 22:20:04.649062 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 22:20:04.653991 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:04.664875 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 22:20:04.711626 tst mo_mt_sms.py: using LAC 17132 22:20:04.837187 tst mo_mt_sms.py: using RAC 47 22:20:04.960847 tst mo_mt_sms.py: using CellId 17132 22:20:05.087077 tst mo_mt_sms.py: using BVCI 17133 22:20:05.203826 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:05.214783 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:05.225604 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:05.236281 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:05.247056 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:05.257770 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 22:20:05.371530 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 22:20:05.489367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:20:05.980341 run create_hlr_db(pid=20487): Launched 22:20:06.109638 bus /sierra_2: Setting Powered False 22:20:07.173021 run create_hlr_db(pid=20487): Terminated: ok {rc=0} 22:20:07.598653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20489): Launched 22:20:07.896800 run osmo-hlr_10.42.42.2(pid=20490): Launched 22:20:08.009949 run osmo-stp_10.42.42.5: Starting osmo-stp 22:20:08.521225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20492): Launched 22:20:08.818533 run osmo-stp_10.42.42.5(pid=20493): Launched 22:20:08.931742 run osmo-msc_10.42.42.6: Starting osmo-msc 22:20:09.469243 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20495): Launched 22:20:09.767022 run osmo-msc_10.42.42.6(pid=20496): Launched 22:20:09.933540 run osmo-stp_10.42.42.5(pid=20493): ERR: Terminated: ERROR {rc=1} [trial-2350↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20493)] 22:20:10.060560 run osmo-stp_10.42.42.5(pid=20493): stdout: | (launched: 2022-12-08_22:20:08.764586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:10.188084 run osmo-stp_10.42.42.5(pid=20493): stderr: | 20221208222008931 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222008932 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222008932 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222008932 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222008934 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222008935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222008935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:10.313301 run osmo-stp_10.42.42.5(pid=20493): stdout: | (launched: 2022-12-08_22:20:08.764586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:10.432318 run osmo-stp_10.42.42.5(pid=20493): stderr: | 20221208222008931 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222008932 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222008932 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222008932 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222008934 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222008935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222008935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:10.574731 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=20493): Process ended prematurely: osmo-stp_10.42.42.5(pid=20493) [trial-2350↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20493)] [trial-2350↪sms:trx-umtrx↪mo_mt_sms.py:16] 22:20:10.583171 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 22:20:10.609799 run osmo-hlr_10.42.42.2(pid=20490): ERR: Terminated: ERROR {rc=237} [trial-2350↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20490)] 22:20:10.658784 run osmo-hlr_10.42.42.2(pid=20490): stdout: | (launched: 2022-12-08_22:20:07.842163) 22:20:10.709646 run osmo-hlr_10.42.42.2(pid=20490): stderr: | 20221208222008019 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222008019 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222008019 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222008019 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222008019 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222008020 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222008031 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222008040 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222008041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222008041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:20:10.779957 run osmo-msc_10.42.42.6(pid=20496): ERR: Terminated: ERROR {rc=2} [trial-2350↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20496)] 22:20:10.828735 run osmo-msc_10.42.42.6(pid=20496): stdout: | (launched: 2022-12-08_22:20:09.712084) 22:20:10.879019 run osmo-msc_10.42.42.6(pid=20496): stderr: | 20221208222009982 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208222009983 DLGLOBAL DEBUG validating counter group 0x7fd92d54bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208222009983 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208222009983 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208222009983 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208222009984 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208222009986 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208222009986 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208222009986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208222009986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:20:10.929710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20489): Terminating (SIGTERM) 22:20:10.970164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20492): Terminating (SIGTERM) 22:20:11.010656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20495): Terminating (SIGTERM) 22:20:11.051293 --- ParallelTerminationStrategy: PID 20489 died... 22:20:11.070481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20489): Terminated: ok {rc=0} 22:20:11.115691 --- ParallelTerminationStrategy: PID 20492 died... 22:20:11.134419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20492): Terminated: ok {rc=0} 22:20:11.179269 --- ParallelTerminationStrategy: PID 20495 died... 22:20:11.198123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20495): Terminated: ok {rc=0} 22:20:11.282979 bus /sierra_3: Setting Powered False 22:20:12.382636 bus /sierra_3: Setting Powered False 22:20:13.506721 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 22:20:14.742081 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:20:14.746147 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 22:20:14.779232 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 22:20:14.786163 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 22:20:14.822526 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 22:20:14.855415 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 22:20:14.862309 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 22:20:15.382993 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2350 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 22:20:15.388116 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 22:20:15.399196 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 22:20:15.446679 tst assert_extension.py: using LAC 17133 22:20:15.570046 tst assert_extension.py: using RAC 48 22:20:15.695637 tst assert_extension.py: using CellId 17133 22:20:15.820443 tst assert_extension.py: using BVCI 17134 22:20:15.958780 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 22:20:16.109075 tst assert_extension.py:10: start nitb and bts... 22:20:16.375362 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:20:17.013872 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20852): Launched 22:20:17.323959 run osmo-nitb_10.42.42.2(pid=20853): Launched 22:20:17.490476 run osmo-nitb_10.42.42.2(pid=20853): ERR: Terminated: ERROR {rc=2} [trial-2350↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20853)] 22:20:17.626009 run osmo-nitb_10.42.42.2(pid=20853): stdout: | (launched: 2022-12-08_22:20:17.270542) 22:20:17.762670 run osmo-nitb_10.42.42.2(pid=20853): stderr: | (launched: 2022-12-08_22:20:17.314932) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:20:17.899310 run osmo-nitb_10.42.42.2(pid=20853): stdout: | (launched: 2022-12-08_22:20:17.270542) 22:20:18.030102 run osmo-nitb_10.42.42.2(pid=20853): stderr: | (launched: 2022-12-08_22:20:17.314932) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3c9519268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20853): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20853) [trial-2350↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20853)] 22:20:18.437582 tst osmo-nitb_10.42.42.2(pid=20853): stdout: | (launched: 2022-12-08_22:20:17.270542) 22:20:18.557647 tst osmo-nitb_10.42.42.2(pid=20853): stderr: | (launched: 2022-12-08_22:20:17.314932) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:20:18.699477 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=20853): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20853) [trial-2350↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20853)] [trial-2350↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 22:20:18.707901 tst assert_extension.py:12: Test FAILED (3.3 sec) 22:20:18.714462 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20852): Terminating (SIGTERM) 22:20:18.924698 --- ParallelTerminationStrategy: PID 20852 died... 22:20:18.945790 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20852): Terminated: ok {rc=0} 22:20:19.032232 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 ussd:trx-umtrx --------------------------------------------------------------------- 22:20:20.215469 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:20:20.220038 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 22:20:20.252838 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 22:20:20.280253 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 22:20:20.314414 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 22:20:20.347402 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 22:20:20.374417 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 22:20:20.904937 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2350 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 22:20:20.910041 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:20.920823 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 22:20:20.968173 tst assert_extension.py: using LAC 17134 22:20:21.089421 tst assert_extension.py: using RAC 49 22:20:21.213608 tst assert_extension.py: using CellId 17134 22:20:21.339144 tst assert_extension.py: using BVCI 17135 22:20:21.454639 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:21.465717 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:21.476465 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:21.487276 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:21.498132 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:21.508996 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 22:20:21.621882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:20:22.082580 run create_hlr_db(pid=20857): Launched 22:20:22.203915 bus /sierra_2: Setting Powered False 22:20:23.267595 run create_hlr_db(pid=20857): Terminated: ok {rc=0} 22:20:23.705915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21034): Launched 22:20:24.009357 run osmo-hlr_10.42.42.2(pid=21035): Launched 22:20:24.123022 run osmo-stp_10.42.42.5: Starting osmo-stp 22:20:24.905770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21037): Launched 22:20:25.229779 run osmo-stp_10.42.42.5(pid=21038): Launched 22:20:25.459502 run osmo-msc_10.42.42.6: Starting osmo-msc 22:20:26.177675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21040): Launched 22:20:26.491341 run osmo-msc_10.42.42.6(pid=21041): Launched 22:20:26.831574 run osmo-stp_10.42.42.5(pid=21038): ERR: Terminated: ERROR {rc=1} [trial-2350↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21038)] 22:20:27.086830 run osmo-stp_10.42.42.5(pid=21038): stdout: | (launched: 2022-12-08_22:20:25.161130) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:27.355044 run osmo-stp_10.42.42.5(pid=21038): stderr: | 20221208222025494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222025494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222025494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222025494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222025495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222025495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222025495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:27.553994 run osmo-stp_10.42.42.5(pid=21038): stdout: | (launched: 2022-12-08_22:20:25.161130) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:27.678754 run osmo-stp_10.42.42.5(pid=21038): stderr: | 20221208222025494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222025494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222025494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222025494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222025495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222025495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222025495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:27.824699 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=21038): Process ended prematurely: osmo-stp_10.42.42.5(pid=21038) [trial-2350↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21038)] [trial-2350↪ussd:trx-umtrx↪assert_extension.py:17] 22:20:27.834147 tst assert_extension.py:17: Test FAILED (6.9 sec) 22:20:27.864117 run osmo-hlr_10.42.42.2(pid=21035): ERR: Terminated: ERROR {rc=237} [trial-2350↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21035)] 22:20:27.916495 run osmo-hlr_10.42.42.2(pid=21035): stdout: | (launched: 2022-12-08_22:20:23.952425) 22:20:27.970801 run osmo-hlr_10.42.42.2(pid=21035): stderr: | 20221208222024298 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222024298 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222024298 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222024298 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222024298 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222024298 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222024326 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222024339 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222024339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222024339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:20:28.044919 run osmo-msc_10.42.42.6(pid=21041): ERR: Terminated: ERROR {rc=2} [trial-2350↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21041)] 22:20:28.095836 run osmo-msc_10.42.42.6(pid=21041): stdout: | (launched: 2022-12-08_22:20:26.433656) 22:20:28.148500 run osmo-msc_10.42.42.6(pid=21041): stderr: | 20221208222027030 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208222027030 DLGLOBAL DEBUG validating counter group 0x7fd5f4180c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208222027030 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208222027030 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208222027030 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208222027031 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208222027032 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208222027033 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208222027033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208222027033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:20:28.199587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21034): Terminating (SIGTERM) 22:20:28.240357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21037): Terminating (SIGTERM) 22:20:28.281812 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21040): Terminating (SIGTERM) 22:20:28.323206 --- ParallelTerminationStrategy: PID 21034 died... 22:20:28.342563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21034): Terminated: ok {rc=0} 22:20:28.387746 --- ParallelTerminationStrategy: PID 21037 died... 22:20:28.406602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21037): Terminated: ok {rc=0} 22:20:28.451550 --- ParallelTerminationStrategy: PID 21040 died... 22:20:28.470335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21040): Terminated: ok {rc=0} 22:20:28.555331 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:20:29.762263 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:20:29.769215 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:20:29.802285 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:20:29.829374 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:20:29.879529 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:20:29.911907 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:20:29.938778 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:20:30.493161 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:20:30.545193 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:30.556503 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:20:30.632510 tst mo_mt_call.py: using LAC 17135 22:20:30.768921 tst mo_mt_call.py: using RAC 50 22:20:30.898327 tst mo_mt_call.py: using CellId 17135 22:20:31.031705 tst mo_mt_call.py: using BVCI 17136 22:20:31.174220 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:31.186285 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:31.198209 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:31.210397 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:31.222459 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:31.234516 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:20:31.351388 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:20:31.474322 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:20:31.982830 run create_hlr_db(pid=21047): Launched 22:20:32.124347 bus /sierra_2: Setting Powered False 22:20:33.185762 run create_hlr_db(pid=21047): Terminated: ok {rc=0} 22:20:33.607503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21049): Launched 22:20:33.910330 run osmo-hlr_10.42.42.2(pid=21050): Launched 22:20:34.025293 run osmo-stp_10.42.42.5: Starting osmo-stp 22:20:34.549340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21052): Launched 22:20:34.852494 run osmo-stp_10.42.42.5(pid=21053): Launched 22:20:34.967653 run osmo-msc_10.42.42.6: Starting osmo-msc 22:20:35.521198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21055): Launched 22:20:35.824399 run osmo-msc_10.42.42.6(pid=21056): Launched 22:20:35.994090 run osmo-stp_10.42.42.5(pid=21053): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21053)] 22:20:36.124320 run osmo-stp_10.42.42.5(pid=21053): stdout: | (launched: 2022-12-08_22:20:34.797431) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:36.253841 run osmo-stp_10.42.42.5(pid=21053): stderr: | 20221208222034966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222034966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222034967 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222034967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222034968 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222034968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222034968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:36.380937 run osmo-stp_10.42.42.5(pid=21053): stdout: | (launched: 2022-12-08_22:20:34.797431) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:36.502404 run osmo-stp_10.42.42.5(pid=21053): stderr: | 20221208222034966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222034966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222034967 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222034967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222034968 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222034968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222034968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:36.647620 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21053): Process ended prematurely: osmo-stp_10.42.42.5(pid=21053) [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21053)] [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:20:36.656658 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:20:36.683659 run osmo-hlr_10.42.42.2(pid=21050): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21050)] 22:20:36.733082 run osmo-hlr_10.42.42.2(pid=21050): stdout: | (launched: 2022-12-08_22:20:33.855873) 22:20:36.783668 run osmo-hlr_10.42.42.2(pid=21050): stderr: | 20221208222034031 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222034031 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222034031 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222034031 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222034031 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222034031 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222034043 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222034052 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222034052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222034052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:20:36.854268 run osmo-msc_10.42.42.6(pid=21056): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21056)] 22:20:36.903136 run osmo-msc_10.42.42.6(pid=21056): stdout: | (launched: 2022-12-08_22:20:35.769526) 22:20:36.954055 run osmo-msc_10.42.42.6(pid=21056): stderr: | 20221208222036041 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208222036041 DLGLOBAL DEBUG validating counter group 0x7f73e475cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208222036041 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208222036041 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208222036041 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208222036042 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208222036043 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208222036044 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208222036044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208222036044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:20:37.004857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21049): Terminating (SIGTERM) 22:20:37.045590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21052): Terminating (SIGTERM) 22:20:37.086299 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21055): Terminating (SIGTERM) 22:20:37.127324 --- ParallelTerminationStrategy: PID 21049 died... 22:20:37.146669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21049): Terminated: ok {rc=0} 22:20:37.192168 --- ParallelTerminationStrategy: PID 21052 died... 22:20:37.211606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21052): Terminated: ok {rc=0} 22:20:37.257578 --- ParallelTerminationStrategy: PID 21055 died... 22:20:37.276545 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21055): Terminated: ok {rc=0} 22:20:37.364245 bus /sierra_3: Setting Powered False 22:20:38.465726 bus /sierra_3: Setting Powered False 22:20:39.580875 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:20:40.724835 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:40.736439 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:20:40.805719 tst mo_mt_call_osmux.py: using LAC 17136 22:20:40.935552 tst mo_mt_call_osmux.py: using RAC 51 22:20:41.063835 tst mo_mt_call_osmux.py: using CellId 17136 22:20:41.191713 tst mo_mt_call_osmux.py: using BVCI 17137 22:20:41.309764 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:41.321368 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:41.332688 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:41.344284 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:41.355764 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:41.367093 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:20:41.481112 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:20:41.600251 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:20:42.101729 run create_hlr_db(pid=21058): Launched 22:20:42.232650 bus /sierra_2: Setting Powered False 22:20:43.297250 run create_hlr_db(pid=21058): Terminated: ok {rc=0} 22:20:43.745367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21060): Launched 22:20:44.067643 run osmo-hlr_10.42.42.2(pid=21061): Launched 22:20:44.189723 run osmo-stp_10.42.42.5: Starting osmo-stp 22:20:44.744704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21063): Launched 22:20:45.067482 run osmo-stp_10.42.42.5(pid=21064): Launched 22:20:45.190439 run osmo-msc_10.42.42.6: Starting osmo-msc 22:20:45.776660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21066): Launched 22:20:46.115864 run osmo-msc_10.42.42.6(pid=21067): Launched 22:20:46.416713 run osmo-stp_10.42.42.5(pid=21064): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21064)] 22:20:46.645525 run osmo-stp_10.42.42.5(pid=21064): stdout: | (launched: 2022-12-08_22:20:45.009193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:46.922312 run osmo-stp_10.42.42.5(pid=21064): stderr: | 20221208222045200 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222045200 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222045201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222045201 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222045201 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222045201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222045202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:47.061358 run osmo-stp_10.42.42.5(pid=21064): stdout: | (launched: 2022-12-08_22:20:45.009193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:47.195520 run osmo-stp_10.42.42.5(pid=21064): stderr: | 20221208222045200 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222045200 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222045201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222045201 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222045201 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222045201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222045202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:47.352127 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21064): Process ended prematurely: osmo-stp_10.42.42.5(pid=21064) [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21064)] [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:20:47.361926 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 22:20:47.390238 run osmo-hlr_10.42.42.2(pid=21061): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21061)] 22:20:47.441857 run osmo-hlr_10.42.42.2(pid=21061): stdout: | (launched: 2022-12-08_22:20:44.009556) 22:20:47.494939 run osmo-hlr_10.42.42.2(pid=21061): stderr: | 20221208222044207 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222044207 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222044207 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222044207 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222044207 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222044207 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222044220 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222044228 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222044229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222044229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:20:47.568911 run osmo-msc_10.42.42.6(pid=21067): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21067)] 22:20:47.619914 run osmo-msc_10.42.42.6(pid=21067): stdout: | (launched: 2022-12-08_22:20:46.052426) 22:20:47.672921 run osmo-msc_10.42.42.6(pid=21067): stderr: | 20221208222046661 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208222046661 DLGLOBAL DEBUG validating counter group 0x7f953955ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208222046661 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208222046661 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208222046661 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208222046661 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208222046663 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208222046663 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208222046664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208222046664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:20:47.726110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21060): Terminating (SIGTERM) 22:20:47.768660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21063): Terminating (SIGTERM) 22:20:47.811625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21066): Terminating (SIGTERM) 22:20:47.855157 --- ParallelTerminationStrategy: PID 21060 died... 22:20:47.875580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21060): Terminated: ok {rc=0} 22:20:47.923449 --- ParallelTerminationStrategy: PID 21063 died... 22:20:47.943406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21063): Terminated: ok {rc=0} 22:20:47.990615 --- ParallelTerminationStrategy: PID 21066 died... 22:20:48.010869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21066): Terminated: ok {rc=0} 22:20:48.099865 bus /sierra_3: Setting Powered False 22:20:49.200218 bus /sierra_3: Setting Powered False 22:20:50.317611 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:20:51.566109 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:20:51.572720 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:20:51.605331 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:20:51.631391 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:20:51.683740 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:20:51.715843 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:20:51.741887 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:20:52.290785 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:20:52.339854 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:20:52.350913 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:20:52.418055 tst mo_mt_call.py: using LAC 17137 22:20:52.537843 tst mo_mt_call.py: using RAC 52 22:20:52.657653 tst mo_mt_call.py: using CellId 17137 22:20:52.778897 tst mo_mt_call.py: using BVCI 17138 22:20:52.891057 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:20:52.902142 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:20:52.912864 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:20:52.923891 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:20:52.934980 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:20:52.946144 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:20:53.060848 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:20:53.176650 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:20:53.646016 run create_hlr_db(pid=21072): Launched 22:20:53.761157 bus /sierra_2: Setting Powered False 22:20:54.822177 run create_hlr_db(pid=21072): Terminated: ok {rc=0} 22:20:55.267182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21074): Launched 22:20:55.591658 run osmo-hlr_10.42.42.2(pid=21075): Launched 22:20:55.715973 run osmo-stp_10.42.42.5: Starting osmo-stp 22:20:56.275482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21077): Launched 22:20:56.600248 run osmo-stp_10.42.42.5(pid=21078): Launched 22:20:56.725188 run osmo-msc_10.42.42.6: Starting osmo-msc 22:20:57.313695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21080): Launched 22:20:57.638573 run osmo-msc_10.42.42.6(pid=21081): Launched 22:20:57.821764 run osmo-stp_10.42.42.5(pid=21078): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21078)] 22:20:57.960230 run osmo-stp_10.42.42.5(pid=21078): stdout: | (launched: 2022-12-08_22:20:56.541088) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:58.098647 run osmo-stp_10.42.42.5(pid=21078): stderr: | 20221208222056734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222056734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222056734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222056735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222056735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222056735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222056735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:58.235750 run osmo-stp_10.42.42.5(pid=21078): stdout: | (launched: 2022-12-08_22:20:56.541088) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:58.365720 run osmo-stp_10.42.42.5(pid=21078): stderr: | 20221208222056734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222056734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222056734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222056735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222056735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222056735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222056735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:58.521187 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21078): Process ended prematurely: osmo-stp_10.42.42.5(pid=21078) [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21078)] [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:20:58.530910 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:20:58.559471 run osmo-hlr_10.42.42.2(pid=21075): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21075)] 22:20:58.611089 run osmo-hlr_10.42.42.2(pid=21075): stdout: | (launched: 2022-12-08_22:20:55.533529) 22:20:58.664900 run osmo-hlr_10.42.42.2(pid=21075): stderr: | 20221208222055733 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222055733 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222055733 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222055733 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222055733 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222055733 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222055744 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222055753 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222055753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222055753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:20:58.738855 run osmo-msc_10.42.42.6(pid=21081): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21081)] 22:20:58.790222 run osmo-msc_10.42.42.6(pid=21081): stdout: | (launched: 2022-12-08_22:20:57.579850) 22:20:58.843195 run osmo-msc_10.42.42.6(pid=21081): stderr: | 20221208222057901 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208222057901 DLGLOBAL DEBUG validating counter group 0x7f2a9e6aac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208222057901 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208222057901 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208222057901 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208222057901 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208222057905 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208222057905 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208222057905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208222057905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:20:58.896278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21074): Terminating (SIGTERM) 22:20:58.939133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21077): Terminating (SIGTERM) 22:20:58.981971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21080): Terminating (SIGTERM) 22:20:59.025449 --- ParallelTerminationStrategy: PID 21074 died... 22:20:59.045929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21074): Terminated: ok {rc=0} 22:20:59.093781 --- ParallelTerminationStrategy: PID 21077 died... 22:20:59.113996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21077): Terminated: ok {rc=0} 22:20:59.161471 --- ParallelTerminationStrategy: PID 21080 died... 22:20:59.181571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21080): Terminated: ok {rc=0} 22:20:59.271305 bus /sierra_3: Setting Powered False 22:21:00.372119 bus /sierra_3: Setting Powered False 22:21:01.489704 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:21:02.635661 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:21:02.647366 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:21:02.716746 tst mo_mt_call_osmux.py: using LAC 17138 22:21:02.837871 tst mo_mt_call_osmux.py: using RAC 53 22:21:02.962900 tst mo_mt_call_osmux.py: using CellId 17138 22:21:03.082887 tst mo_mt_call_osmux.py: using BVCI 17139 22:21:03.196595 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:21:03.207693 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:21:03.218557 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:21:03.229674 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:21:03.240757 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:21:03.251873 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:21:03.368261 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:21:03.486539 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:21:03.955064 run create_hlr_db(pid=21083): Launched 22:21:04.070349 bus /sierra_2: Setting Powered False 22:21:05.131144 run create_hlr_db(pid=21083): Terminated: ok {rc=0} 22:21:05.552801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21085): Launched 22:21:05.855153 run osmo-hlr_10.42.42.2(pid=21086): Launched 22:21:05.973558 run osmo-stp_10.42.42.5: Starting osmo-stp 22:21:06.512743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21088): Launched 22:21:06.815258 run osmo-stp_10.42.42.5(pid=21089): Launched 22:21:06.930242 run osmo-msc_10.42.42.6: Starting osmo-msc 22:21:07.478308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21091): Launched 22:21:07.781317 run osmo-msc_10.42.42.6(pid=21092): Launched 22:21:07.950067 run osmo-stp_10.42.42.5(pid=21089): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21089)] 22:21:08.079368 run osmo-stp_10.42.42.5(pid=21089): stdout: | (launched: 2022-12-08_22:21:06.760452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:08.208508 run osmo-stp_10.42.42.5(pid=21089): stderr: | 20221208222106927 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222106927 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222106928 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222106928 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222106930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222106930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222106931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:08.335933 run osmo-stp_10.42.42.5(pid=21089): stdout: | (launched: 2022-12-08_22:21:06.760452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:08.457249 run osmo-stp_10.42.42.5(pid=21089): stderr: | 20221208222106927 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222106927 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222106928 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222106928 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222106930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222106930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222106931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:08.602121 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21089): Process ended prematurely: osmo-stp_10.42.42.5(pid=21089) [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21089)] [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:21:08.610909 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 22:21:08.637939 run osmo-hlr_10.42.42.2(pid=21086): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21086)] 22:21:08.686227 run osmo-hlr_10.42.42.2(pid=21086): stdout: | (launched: 2022-12-08_22:21:05.800109) 22:21:08.736280 run osmo-hlr_10.42.42.2(pid=21086): stderr: | 20221208222105977 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222105977 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222105977 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222105977 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222105977 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222105977 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222105988 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222105997 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222105998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222105998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:21:08.806298 run osmo-msc_10.42.42.6(pid=21092): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21092)] 22:21:08.854496 run osmo-msc_10.42.42.6(pid=21092): stdout: | (launched: 2022-12-08_22:21:07.726481) 22:21:08.904349 run osmo-msc_10.42.42.6(pid=21092): stderr: | 20221208222107999 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208222108000 DLGLOBAL DEBUG validating counter group 0x7fa28aa58c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208222108000 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208222108000 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208222108000 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208222108000 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208222108003 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208222108003 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208222108003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208222108004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:21:08.954484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21085): Terminating (SIGTERM) 22:21:08.994526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21088): Terminating (SIGTERM) 22:21:09.034627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21091): Terminating (SIGTERM) 22:21:09.075273 --- ParallelTerminationStrategy: PID 21085 died... 22:21:09.094437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21085): Terminated: ok {rc=0} 22:21:09.139295 --- ParallelTerminationStrategy: PID 21088 died... 22:21:09.158008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21088): Terminated: ok {rc=0} 22:21:09.202828 --- ParallelTerminationStrategy: PID 21091 died... 22:21:09.221542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21091): Terminated: ok {rc=0} 22:21:09.307906 bus /sierra_3: Setting Powered False 22:21:10.407881 bus /sierra_3: Setting Powered False 22:21:11.523498 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:21:12.767678 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:21:12.773910 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:21:12.806118 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:21:12.832420 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:21:12.883292 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:21:12.915243 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:21:12.941273 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:21:13.491254 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:21:13.540667 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:13.551700 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:21:13.618788 tst mo_mt_call.py: using LAC 17139 22:21:13.738118 tst mo_mt_call.py: using RAC 54 22:21:13.859934 tst mo_mt_call.py: using CellId 17139 22:21:13.980330 tst mo_mt_call.py: using BVCI 17140 22:21:14.101747 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:14.113282 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:14.124625 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:14.136088 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:14.147512 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:14.158978 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:21:14.273538 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:21:14.392443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:21:14.861457 run create_hlr_db(pid=21097): Launched 22:21:14.978085 bus /sierra_2: Setting Powered False 22:21:16.040443 run create_hlr_db(pid=21097): Terminated: ok {rc=0} 22:21:16.479887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21099): Launched 22:21:16.798221 run osmo-hlr_10.42.42.2(pid=21100): Launched 22:21:17.034294 run osmo-stp_10.42.42.5: Starting osmo-stp 22:21:17.636028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21102): Launched 22:21:17.959099 run osmo-stp_10.42.42.5(pid=21103): Launched 22:21:18.082779 run osmo-msc_10.42.42.6: Starting osmo-msc 22:21:18.668063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21105): Launched 22:21:18.991401 run osmo-msc_10.42.42.6(pid=21106): Launched 22:21:19.171541 run osmo-stp_10.42.42.5(pid=21103): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21103)] 22:21:19.312640 run osmo-stp_10.42.42.5(pid=21103): stdout: | (launched: 2022-12-08_22:21:17.901051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:19.450872 run osmo-stp_10.42.42.5(pid=21103): stderr: | 20221208222118093 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222118093 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222118093 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222118094 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222118094 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222118094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222118094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:19.586774 run osmo-stp_10.42.42.5(pid=21103): stdout: | (launched: 2022-12-08_22:21:17.901051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:19.716221 run osmo-stp_10.42.42.5(pid=21103): stderr: | 20221208222118093 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222118093 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222118093 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222118094 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222118094 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222118094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222118094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:19.871202 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21103): Process ended prematurely: osmo-stp_10.42.42.5(pid=21103) [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21103)] [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:21:19.880652 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 22:21:19.908696 run osmo-hlr_10.42.42.2(pid=21100): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21100)] 22:21:19.959862 run osmo-hlr_10.42.42.2(pid=21100): stdout: | (launched: 2022-12-08_22:21:16.739628) 22:21:20.012513 run osmo-hlr_10.42.42.2(pid=21100): stderr: | 20221208222117089 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222117090 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222117090 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222117090 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222117090 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222117090 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222117105 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222117123 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222117123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222117123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:21:20.086749 run osmo-msc_10.42.42.6(pid=21106): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21106)] 22:21:20.137792 run osmo-msc_10.42.42.6(pid=21106): stdout: | (launched: 2022-12-08_22:21:18.932855) 22:21:20.190396 run osmo-msc_10.42.42.6(pid=21106): stderr: | 20221208222119256 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208222119256 DLGLOBAL DEBUG validating counter group 0x7f44718eac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208222119256 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208222119256 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208222119257 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208222119257 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208222119258 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208222119259 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208222119259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208222119259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:21:20.243096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21099): Terminating (SIGTERM) 22:21:20.285375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21102): Terminating (SIGTERM) 22:21:20.327720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21105): Terminating (SIGTERM) 22:21:20.370338 --- ParallelTerminationStrategy: PID 21099 died... 22:21:20.390642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21099): Terminated: ok {rc=0} 22:21:20.437808 --- ParallelTerminationStrategy: PID 21102 died... 22:21:20.457673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21102): Terminated: ok {rc=0} 22:21:20.504820 --- ParallelTerminationStrategy: PID 21105 died... 22:21:20.525097 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21105): Terminated: ok {rc=0} 22:21:20.614081 bus /sierra_3: Setting Powered False 22:21:21.714799 bus /sierra_3: Setting Powered False 22:21:22.834023 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:21:23.986772 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:23.998891 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:21:24.069990 tst mo_mt_call_osmux.py: using LAC 17140 22:21:24.199612 tst mo_mt_call_osmux.py: using RAC 55 22:21:24.326673 tst mo_mt_call_osmux.py: using CellId 17140 22:21:24.453440 tst mo_mt_call_osmux.py: using BVCI 17141 22:21:24.573438 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:24.584937 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:24.596296 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:24.607669 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:24.619260 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:24.630653 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:21:24.751990 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:21:24.869817 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:21:25.340410 run create_hlr_db(pid=21108): Launched 22:21:25.456761 bus /sierra_2: Setting Powered False 22:21:26.518153 run create_hlr_db(pid=21108): Terminated: ok {rc=0} 22:21:26.961625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21110): Launched 22:21:27.288307 run osmo-hlr_10.42.42.2(pid=21111): Launched 22:21:27.412272 run osmo-stp_10.42.42.5: Starting osmo-stp 22:21:27.975543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21113): Launched 22:21:28.300089 run osmo-stp_10.42.42.5(pid=21114): Launched 22:21:28.423148 run osmo-msc_10.42.42.6: Starting osmo-msc 22:21:29.008051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21116): Launched 22:21:29.331101 run osmo-msc_10.42.42.6(pid=21117): Launched 22:21:29.510952 run osmo-stp_10.42.42.5(pid=21114): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21114)] 22:21:29.647927 run osmo-stp_10.42.42.5(pid=21114): stdout: | (launched: 2022-12-08_22:21:28.241783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:29.784554 run osmo-stp_10.42.42.5(pid=21114): stderr: | 20221208222128436 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222128436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222128436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222128437 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222128437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222128437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222128437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:29.920447 run osmo-stp_10.42.42.5(pid=21114): stdout: | (launched: 2022-12-08_22:21:28.241783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:30.049957 run osmo-stp_10.42.42.5(pid=21114): stderr: | 20221208222128436 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222128436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222128436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222128437 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222128437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222128437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222128437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:30.204573 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21114): Process ended prematurely: osmo-stp_10.42.42.5(pid=21114) [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21114)] [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:21:30.214565 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:21:30.242704 run osmo-hlr_10.42.42.2(pid=21111): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21111)] 22:21:30.293705 run osmo-hlr_10.42.42.2(pid=21111): stdout: | (launched: 2022-12-08_22:21:27.229744) 22:21:30.346498 run osmo-hlr_10.42.42.2(pid=21111): stderr: | 20221208222127427 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222127427 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222127427 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222127427 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222127427 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222127427 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222127438 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222127447 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222127447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222127447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:21:30.420005 run osmo-msc_10.42.42.6(pid=21117): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21117)] 22:21:30.470791 run osmo-msc_10.42.42.6(pid=21117): stdout: | (launched: 2022-12-08_22:21:29.272713) 22:21:30.523398 run osmo-msc_10.42.42.6(pid=21117): stderr: | 20221208222129593 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208222129593 DLGLOBAL DEBUG validating counter group 0x7f20f8390c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208222129593 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208222129593 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208222129594 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208222129594 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208222129595 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208222129596 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208222129596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208222129596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:21:30.576231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21110): Terminating (SIGTERM) 22:21:30.618668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21113): Terminating (SIGTERM) 22:21:30.661068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21116): Terminating (SIGTERM) 22:21:30.703880 --- ParallelTerminationStrategy: PID 21110 died... 22:21:30.723965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21110): Terminated: ok {rc=0} 22:21:30.771248 --- ParallelTerminationStrategy: PID 21113 died... 22:21:30.791080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21113): Terminated: ok {rc=0} 22:21:30.841136 --- ParallelTerminationStrategy: PID 21116 died... 22:21:30.861088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21116): Terminated: ok {rc=0} 22:21:30.954607 bus /sierra_3: Setting Powered False 22:21:32.056532 bus /sierra_3: Setting Powered False 22:21:33.171682 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 22:21:34.422582 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:21:34.429996 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 22:21:34.463118 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 22:21:34.490251 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 22:21:34.543898 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 22:21:34.577063 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 22:21:34.604088 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 22:21:35.156794 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 22:21:35.208484 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:35.220002 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:21:35.288543 tst mo_mt_call.py: using LAC 17141 22:21:35.414493 tst mo_mt_call.py: using RAC 56 22:21:35.539926 tst mo_mt_call.py: using CellId 17141 22:21:35.665735 tst mo_mt_call.py: using BVCI 17142 22:21:35.783612 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:35.795085 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:35.806534 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:35.817912 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:35.829340 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:35.840540 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:21:35.955395 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:21:36.076940 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:21:36.578426 run create_hlr_db(pid=21122): Launched 22:21:36.709420 bus /sierra_2: Setting Powered False 22:21:37.773990 run create_hlr_db(pid=21122): Terminated: ok {rc=0} 22:21:38.224235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21124): Launched 22:21:38.546685 run osmo-hlr_10.42.42.2(pid=21125): Launched 22:21:38.670419 run osmo-stp_10.42.42.5: Starting osmo-stp 22:21:39.227178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21127): Launched 22:21:39.551519 run osmo-stp_10.42.42.5(pid=21128): Launched 22:21:39.675267 run osmo-msc_10.42.42.6: Starting osmo-msc 22:21:40.261712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21130): Launched 22:21:40.586688 run osmo-msc_10.42.42.6(pid=21131): Launched 22:21:40.767189 run osmo-stp_10.42.42.5(pid=21128): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21128)] 22:21:40.903897 run osmo-stp_10.42.42.5(pid=21128): stdout: | (launched: 2022-12-08_22:21:39.493072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:41.041876 run osmo-stp_10.42.42.5(pid=21128): stderr: | 20221208222139687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222139687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222139687 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222139688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222139688 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222139688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222139688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:41.178508 run osmo-stp_10.42.42.5(pid=21128): stdout: | (launched: 2022-12-08_22:21:39.493072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:41.307705 run osmo-stp_10.42.42.5(pid=21128): stderr: | 20221208222139687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222139687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222139687 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222139688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222139688 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222139688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222139688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:41.462414 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21128): Process ended prematurely: osmo-stp_10.42.42.5(pid=21128) [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21128)] [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 22:21:41.471752 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:21:41.499942 run osmo-hlr_10.42.42.2(pid=21125): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21125)] 22:21:41.551215 run osmo-hlr_10.42.42.2(pid=21125): stdout: | (launched: 2022-12-08_22:21:38.488428) 22:21:41.604283 run osmo-hlr_10.42.42.2(pid=21125): stderr: | 20221208222138685 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222138685 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222138685 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222138685 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222138685 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222138685 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222138699 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222138709 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222138709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222138709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:21:41.677922 run osmo-msc_10.42.42.6(pid=21131): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21131)] 22:21:41.729124 run osmo-msc_10.42.42.6(pid=21131): stdout: | (launched: 2022-12-08_22:21:40.528115) 22:21:41.781971 run osmo-msc_10.42.42.6(pid=21131): stderr: | 20221208222140851 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208222140851 DLGLOBAL DEBUG validating counter group 0x7fb248ed7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208222140851 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208222140851 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208222140851 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208222140852 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208222140853 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208222140854 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208222140854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208222140854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:21:41.836157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21124): Terminating (SIGTERM) 22:21:41.878661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21127): Terminating (SIGTERM) 22:21:41.921342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21130): Terminating (SIGTERM) 22:21:41.964030 --- ParallelTerminationStrategy: PID 21124 died... 22:21:41.984237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21124): Terminated: ok {rc=0} 22:21:42.031697 --- ParallelTerminationStrategy: PID 21127 died... 22:21:42.051897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21127): Terminated: ok {rc=0} 22:21:42.099058 --- ParallelTerminationStrategy: PID 21130 died... 22:21:42.118834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21130): Terminated: ok {rc=0} 22:21:42.208412 bus /sierra_3: Setting Powered False 22:21:43.309795 bus /sierra_3: Setting Powered False 22:21:44.429293 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 22:21:45.575951 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:45.587671 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:21:45.655403 tst mo_mt_call_osmux.py: using LAC 17142 22:21:45.783234 tst mo_mt_call_osmux.py: using RAC 57 22:21:45.927014 tst mo_mt_call_osmux.py: using CellId 17142 22:21:46.056162 tst mo_mt_call_osmux.py: using BVCI 17143 22:21:46.177233 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:46.189724 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:46.203128 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:46.214977 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:46.227521 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:46.240799 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:21:46.370631 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:21:46.516865 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:21:47.093267 run create_hlr_db(pid=21133): Launched 22:21:47.254362 bus /sierra_2: Setting Powered False 22:21:48.319146 run create_hlr_db(pid=21133): Terminated: ok {rc=0} 22:21:48.752465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21135): Launched 22:21:49.056234 run osmo-hlr_10.42.42.2(pid=21136): Launched 22:21:49.171985 run osmo-stp_10.42.42.5: Starting osmo-stp 22:21:49.708728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21138): Launched 22:21:50.012606 run osmo-stp_10.42.42.5(pid=21139): Launched 22:21:50.127604 run osmo-msc_10.42.42.6: Starting osmo-msc 22:21:50.677510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21141): Launched 22:21:50.982188 run osmo-msc_10.42.42.6(pid=21142): Launched 22:21:51.150701 run osmo-stp_10.42.42.5(pid=21139): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21139)] 22:21:51.280216 run osmo-stp_10.42.42.5(pid=21139): stdout: | (launched: 2022-12-08_22:21:49.957507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:51.409973 run osmo-stp_10.42.42.5(pid=21139): stderr: | 20221208222150126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222150127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222150127 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222150127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222150130 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222150130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222150130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:51.537146 run osmo-stp_10.42.42.5(pid=21139): stdout: | (launched: 2022-12-08_22:21:49.957507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:51.658017 run osmo-stp_10.42.42.5(pid=21139): stderr: | 20221208222150126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222150127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222150127 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222150127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222150130 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222150130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222150130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:51.803330 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21139): Process ended prematurely: osmo-stp_10.42.42.5(pid=21139) [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21139)] [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 22:21:51.812282 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:21:51.839716 run osmo-hlr_10.42.42.2(pid=21136): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21136)] 22:21:51.889261 run osmo-hlr_10.42.42.2(pid=21136): stdout: | (launched: 2022-12-08_22:21:49.001190) 22:21:51.939822 run osmo-hlr_10.42.42.2(pid=21136): stderr: | 20221208222149175 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222149175 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222149175 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222149175 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222149175 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222149175 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222149187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222149197 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222149198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222149198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:21:52.010651 run osmo-msc_10.42.42.6(pid=21142): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21142)] 22:21:52.059600 run osmo-msc_10.42.42.6(pid=21142): stdout: | (launched: 2022-12-08_22:21:50.926757) 22:21:52.110140 run osmo-msc_10.42.42.6(pid=21142): stderr: | 20221208222151196 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208222151196 DLGLOBAL DEBUG validating counter group 0x7f7490d28c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208222151197 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208222151197 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208222151197 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208222151197 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208222151200 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208222151201 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208222151201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208222151201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:21:52.161407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21135): Terminating (SIGTERM) 22:21:52.202098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21138): Terminating (SIGTERM) 22:21:52.243663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21141): Terminating (SIGTERM) 22:21:52.284644 --- ParallelTerminationStrategy: PID 21135 died... 22:21:52.304059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21135): Terminated: ok {rc=0} 22:21:52.349931 --- ParallelTerminationStrategy: PID 21138 died... 22:21:52.368903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21138): Terminated: ok {rc=0} 22:21:52.414324 --- ParallelTerminationStrategy: PID 21141 died... 22:21:52.433409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21141): Terminated: ok {rc=0} 22:21:52.521166 bus /sierra_3: Setting Powered False 22:21:53.621306 bus /sierra_3: Setting Powered False 22:21:54.734955 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:21:55.976891 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:21:55.983363 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:21:56.016409 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:21:56.042720 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:21:56.094724 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:21:56.128022 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:21:56.154103 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:21:56.702569 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:21:56.757336 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:21:56.769057 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:21:56.839306 tst mo_mt_call.py: using LAC 17143 22:21:56.967041 tst mo_mt_call.py: using RAC 58 22:21:57.095577 tst mo_mt_call.py: using CellId 17143 22:21:57.222286 tst mo_mt_call.py: using BVCI 17144 22:21:57.340022 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:21:57.351492 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:21:57.362736 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:21:57.374004 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:21:57.385446 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:21:57.396656 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:21:57.515474 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:21:57.631765 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:21:58.102123 run create_hlr_db(pid=21147): Launched 22:21:58.217908 bus /sierra_2: Setting Powered False 22:21:59.278794 run create_hlr_db(pid=21147): Terminated: ok {rc=0} 22:21:59.700126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21149): Launched 22:22:00.003864 run osmo-hlr_10.42.42.2(pid=21150): Launched 22:22:00.119986 run osmo-stp_10.42.42.5: Starting osmo-stp 22:22:00.640875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21152): Launched 22:22:00.977003 run osmo-stp_10.42.42.5(pid=21153): Launched 22:22:01.212776 run osmo-msc_10.42.42.6: Starting osmo-msc 22:22:02.009466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21155): Launched 22:22:02.320523 run osmo-msc_10.42.42.6(pid=21156): Launched 22:22:02.490878 run osmo-stp_10.42.42.5(pid=21153): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21153)] 22:22:02.621441 run osmo-stp_10.42.42.5(pid=21153): stdout: | (launched: 2022-12-08_22:22:00.918005) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:02.750781 run osmo-stp_10.42.42.5(pid=21153): stderr: | 20221208222201244 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222201244 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222201253 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222201253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222201254 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222201254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222201254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:02.877943 run osmo-stp_10.42.42.5(pid=21153): stdout: | (launched: 2022-12-08_22:22:00.918005) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:02.999309 run osmo-stp_10.42.42.5(pid=21153): stderr: | 20221208222201244 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222201244 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222201253 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222201253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222201254 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222201254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222201254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:03.144036 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21153): Process ended prematurely: osmo-stp_10.42.42.5(pid=21153) [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21153)] [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:22:03.153041 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 22:22:03.180387 run osmo-hlr_10.42.42.2(pid=21150): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21150)] 22:22:03.229588 run osmo-hlr_10.42.42.2(pid=21150): stdout: | (launched: 2022-12-08_22:21:59.948197) 22:22:03.280630 run osmo-hlr_10.42.42.2(pid=21150): stderr: | 20221208222200125 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222200125 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222200125 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222200125 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222200125 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222200125 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222200176 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222200186 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222200186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222200186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:22:03.351608 run osmo-msc_10.42.42.6(pid=21156): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21156)] 22:22:03.400664 run osmo-msc_10.42.42.6(pid=21156): stdout: | (launched: 2022-12-08_22:22:02.263547) 22:22:03.451470 run osmo-msc_10.42.42.6(pid=21156): stderr: | 20221208222202533 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208222202534 DLGLOBAL DEBUG validating counter group 0x7f120ef7ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208222202534 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208222202534 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208222202534 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208222202534 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208222202536 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208222202536 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208222202536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208222202536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:22:03.502464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21149): Terminating (SIGTERM) 22:22:03.543281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21152): Terminating (SIGTERM) 22:22:03.584064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21155): Terminating (SIGTERM) 22:22:03.625154 --- ParallelTerminationStrategy: PID 21149 died... 22:22:03.644487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21149): Terminated: ok {rc=0} 22:22:03.690111 --- ParallelTerminationStrategy: PID 21152 died... 22:22:03.709182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21152): Terminated: ok {rc=0} 22:22:03.754972 --- ParallelTerminationStrategy: PID 21155 died... 22:22:03.773925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21155): Terminated: ok {rc=0} 22:22:03.859674 bus /sierra_3: Setting Powered False 22:22:04.959370 bus /sierra_3: Setting Powered False 22:22:06.079805 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:22:07.226756 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:22:07.238438 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:22:07.307377 tst mo_mt_call_osmux.py: using LAC 17144 22:22:07.426398 tst mo_mt_call_osmux.py: using RAC 59 22:22:07.548880 tst mo_mt_call_osmux.py: using CellId 17144 22:22:07.671031 tst mo_mt_call_osmux.py: using BVCI 17145 22:22:07.790205 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:22:07.802006 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:22:07.813694 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:22:07.825211 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:22:07.836652 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:22:07.848118 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:22:07.963219 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:22:08.079989 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:22:08.550687 run create_hlr_db(pid=21158): Launched 22:22:08.667513 bus /sierra_2: Setting Powered False 22:22:09.727987 run create_hlr_db(pid=21158): Terminated: ok {rc=0} 22:22:10.171955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21161): Launched 22:22:10.495658 run osmo-hlr_10.42.42.2(pid=21162): Launched 22:22:10.619538 run osmo-stp_10.42.42.5: Starting osmo-stp 22:22:11.176521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21164): Launched 22:22:11.499595 run osmo-stp_10.42.42.5(pid=21165): Launched 22:22:11.623487 run osmo-msc_10.42.42.6: Starting osmo-msc 22:22:12.210040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21167): Launched 22:22:12.535289 run osmo-msc_10.42.42.6(pid=21168): Launched 22:22:12.715670 run osmo-stp_10.42.42.5(pid=21165): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21165)] 22:22:12.852558 run osmo-stp_10.42.42.5(pid=21165): stdout: | (launched: 2022-12-08_22:22:11.441420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:12.989663 run osmo-stp_10.42.42.5(pid=21165): stderr: | 20221208222211634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222211634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222211635 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222211635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222211636 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222211636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222211636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:13.126408 run osmo-stp_10.42.42.5(pid=21165): stdout: | (launched: 2022-12-08_22:22:11.441420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:13.255381 run osmo-stp_10.42.42.5(pid=21165): stderr: | 20221208222211634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222211634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222211635 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222211635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222211636 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222211636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222211636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:13.409827 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21165): Process ended prematurely: osmo-stp_10.42.42.5(pid=21165) [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21165)] [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:22:13.419334 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:22:13.447425 run osmo-hlr_10.42.42.2(pid=21162): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21162)] 22:22:13.498890 run osmo-hlr_10.42.42.2(pid=21162): stdout: | (launched: 2022-12-08_22:22:10.437417) 22:22:13.551779 run osmo-hlr_10.42.42.2(pid=21162): stderr: | 20221208222210636 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222210636 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222210637 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222210637 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222210637 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222210637 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222210649 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222210657 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222210657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222210658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:22:13.625904 run osmo-msc_10.42.42.6(pid=21168): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21168)] 22:22:13.677100 run osmo-msc_10.42.42.6(pid=21168): stdout: | (launched: 2022-12-08_22:22:12.475858) 22:22:13.729953 run osmo-msc_10.42.42.6(pid=21168): stderr: | 20221208222212799 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208222212799 DLGLOBAL DEBUG validating counter group 0x7f8363d80c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208222212799 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208222212799 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208222212799 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208222212800 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208222212802 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208222212803 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208222212803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208222212803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:22:13.782784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21161): Terminating (SIGTERM) 22:22:13.825240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21164): Terminating (SIGTERM) 22:22:13.867615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21167): Terminating (SIGTERM) 22:22:13.910562 --- ParallelTerminationStrategy: PID 21161 died... 22:22:13.931035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21161): Terminated: ok {rc=0} 22:22:13.978508 --- ParallelTerminationStrategy: PID 21164 died... 22:22:13.998657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21164): Terminated: ok {rc=0} 22:22:14.045995 --- ParallelTerminationStrategy: PID 21167 died... 22:22:14.066294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21167): Terminated: ok {rc=0} 22:22:14.155336 bus /sierra_3: Setting Powered False 22:22:15.255736 bus /sierra_3: Setting Powered False 22:22:16.371625 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:22:17.628506 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:22:17.635830 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:22:17.669719 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:22:17.696698 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:22:17.749950 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:22:17.783019 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:22:17.809798 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:22:18.361569 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:22:18.413056 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:18.424521 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:22:18.495846 tst mo_mt_call.py: using LAC 17145 22:22:18.625584 tst mo_mt_call.py: using RAC 60 22:22:18.755552 tst mo_mt_call.py: using CellId 17145 22:22:18.885882 tst mo_mt_call.py: using BVCI 17146 22:22:19.005485 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:19.016933 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:19.028387 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:19.039757 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:19.051199 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:19.063058 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:22:19.183895 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:22:19.302453 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:22:19.805366 run create_hlr_db(pid=21173): Launched 22:22:19.937239 bus /sierra_2: Setting Powered False 22:22:21.001501 run create_hlr_db(pid=21173): Terminated: ok {rc=0} 22:22:21.435004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21176): Launched 22:22:21.738871 run osmo-hlr_10.42.42.2(pid=21177): Launched 22:22:21.854245 run osmo-stp_10.42.42.5: Starting osmo-stp 22:22:22.375790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21179): Launched 22:22:22.679827 run osmo-stp_10.42.42.5(pid=21180): Launched 22:22:22.799092 run osmo-msc_10.42.42.6: Starting osmo-msc 22:22:23.348139 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21182): Launched 22:22:23.652602 run osmo-msc_10.42.42.6(pid=21183): Launched 22:22:23.822723 run osmo-stp_10.42.42.5(pid=21180): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21180)] 22:22:23.953262 run osmo-stp_10.42.42.5(pid=21180): stdout: | (launched: 2022-12-08_22:22:22.624861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:24.083174 run osmo-stp_10.42.42.5(pid=21180): stderr: | 20221208222222795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222222796 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222222796 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222222796 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222222797 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222222797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222222797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:24.211328 run osmo-stp_10.42.42.5(pid=21180): stdout: | (launched: 2022-12-08_22:22:22.624861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:24.333083 run osmo-stp_10.42.42.5(pid=21180): stderr: | 20221208222222795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222222796 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222222796 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222222796 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222222797 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222222797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222222797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:24.478510 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21180): Process ended prematurely: osmo-stp_10.42.42.5(pid=21180) [trial-2350↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21180)] [trial-2350↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:22:24.487451 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:22:24.514760 run osmo-hlr_10.42.42.2(pid=21177): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21177)] 22:22:24.563827 run osmo-hlr_10.42.42.2(pid=21177): stdout: | (launched: 2022-12-08_22:22:21.683942) 22:22:24.615079 run osmo-hlr_10.42.42.2(pid=21177): stderr: | 20221208222221858 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222221858 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222221858 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222221858 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222221858 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222221858 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222221894 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222221903 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222221903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222221903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:22:24.686035 run osmo-msc_10.42.42.6(pid=21183): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21183)] 22:22:24.735256 run osmo-msc_10.42.42.6(pid=21183): stdout: | (launched: 2022-12-08_22:22:23.597347) 22:22:24.786024 run osmo-msc_10.42.42.6(pid=21183): stderr: | 20221208222223868 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208222223868 DLGLOBAL DEBUG validating counter group 0x7fe0e119ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208222223868 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208222223868 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208222223868 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208222223868 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208222223870 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208222223871 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208222223871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208222223871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:22:24.837350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21176): Terminating (SIGTERM) 22:22:24.878328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21179): Terminating (SIGTERM) 22:22:24.919420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21182): Terminating (SIGTERM) 22:22:24.960661 --- ParallelTerminationStrategy: PID 21176 died... 22:22:24.980232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21176): Terminated: ok {rc=0} 22:22:25.026124 --- ParallelTerminationStrategy: PID 21179 died... 22:22:25.045240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21179): Terminated: ok {rc=0} 22:22:25.091481 --- ParallelTerminationStrategy: PID 21182 died... 22:22:25.110766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21182): Terminated: ok {rc=0} 22:22:25.199567 bus /sierra_3: Setting Powered False 22:22:26.301115 bus /sierra_3: Setting Powered False 22:22:27.418830 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:22:28.566268 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:28.578341 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:22:28.647360 tst mo_mt_call_osmux.py: using LAC 17146 22:22:28.767253 tst mo_mt_call_osmux.py: using RAC 61 22:22:28.889029 tst mo_mt_call_osmux.py: using CellId 17146 22:22:29.010899 tst mo_mt_call_osmux.py: using BVCI 17147 22:22:29.123644 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:29.134807 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:29.145722 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:29.156817 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:29.168081 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:29.179854 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:22:29.295726 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:22:29.413196 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:22:29.916245 run create_hlr_db(pid=21185): Launched 22:22:30.048059 bus /sierra_2: Setting Powered False 22:22:31.130718 run create_hlr_db(pid=21185): Terminated: ok {rc=0} 22:22:31.592501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21187): Launched 22:22:31.926668 run osmo-hlr_10.42.42.2(pid=21188): Launched 22:22:32.112866 run osmo-stp_10.42.42.5: Starting osmo-stp 22:22:32.663987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21190): Launched 22:22:32.969526 run osmo-stp_10.42.42.5(pid=21191): Launched 22:22:33.088531 run osmo-msc_10.42.42.6: Starting osmo-msc 22:22:33.640556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21193): Launched 22:22:33.944475 run osmo-msc_10.42.42.6(pid=21194): Launched 22:22:34.114269 run osmo-stp_10.42.42.5(pid=21191): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21191)] 22:22:34.244801 run osmo-stp_10.42.42.5(pid=21191): stdout: | (launched: 2022-12-08_22:22:32.914315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:34.375170 run osmo-stp_10.42.42.5(pid=21191): stderr: | 20221208222233086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222233087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222233087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222233087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222233088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222233088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222233088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:34.503003 run osmo-stp_10.42.42.5(pid=21191): stdout: | (launched: 2022-12-08_22:22:32.914315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:34.624229 run osmo-stp_10.42.42.5(pid=21191): stderr: | 20221208222233086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222233087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222233087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222233087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222233088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222233088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222233088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:34.770412 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21191): Process ended prematurely: osmo-stp_10.42.42.5(pid=21191) [trial-2350↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21191)] [trial-2350↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:22:34.779331 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:22:34.806330 run osmo-hlr_10.42.42.2(pid=21188): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21188)] 22:22:34.855464 run osmo-hlr_10.42.42.2(pid=21188): stdout: | (launched: 2022-12-08_22:22:31.860171) 22:22:34.905874 run osmo-hlr_10.42.42.2(pid=21188): stderr: | 20221208222232201 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222232201 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222232201 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222232201 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222232201 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222232201 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222232214 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222232222 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222232222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222232222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:22:34.976191 run osmo-msc_10.42.42.6(pid=21194): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21194)] 22:22:35.024788 run osmo-msc_10.42.42.6(pid=21194): stdout: | (launched: 2022-12-08_22:22:33.889464) 22:22:35.074916 run osmo-msc_10.42.42.6(pid=21194): stderr: | 20221208222234161 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208222234161 DLGLOBAL DEBUG validating counter group 0x7f7b0ea17c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208222234162 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208222234162 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208222234162 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208222234162 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208222234164 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208222234164 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208222234164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208222234164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:22:35.125521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21187): Terminating (SIGTERM) 22:22:35.166006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21190): Terminating (SIGTERM) 22:22:35.206813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21193): Terminating (SIGTERM) 22:22:35.247944 --- ParallelTerminationStrategy: PID 21187 died... 22:22:35.267358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21187): Terminated: ok {rc=0} 22:22:35.312493 --- ParallelTerminationStrategy: PID 21190 died... 22:22:35.331774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21190): Terminated: ok {rc=0} 22:22:35.377309 --- ParallelTerminationStrategy: PID 21193 died... 22:22:35.396045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21193): Terminated: ok {rc=0} 22:22:35.483648 bus /sierra_3: Setting Powered False 22:22:36.582581 bus /sierra_3: Setting Powered False 22:22:37.700646 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:22:38.953619 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:22:38.960003 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:22:38.994742 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 22:22:39.021929 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 22:22:39.073409 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:22:39.106735 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 22:22:39.133993 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 22:22:39.680916 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 22:22:39.731228 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:39.742226 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:22:39.808330 tst mo_mt_call.py: using LAC 17147 22:22:39.933753 tst mo_mt_call.py: using RAC 62 22:22:40.053366 tst mo_mt_call.py: using CellId 17147 22:22:40.171952 tst mo_mt_call.py: using BVCI 17148 22:22:40.284387 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:40.295417 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:40.306213 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:40.317367 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:40.328278 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:40.339201 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:22:40.457085 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:22:40.575211 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:22:41.077243 run create_hlr_db(pid=21201): Launched 22:22:41.209495 bus /sierra_2: Setting Powered False 22:22:42.274312 run create_hlr_db(pid=21201): Terminated: ok {rc=0} 22:22:42.707578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21203): Launched 22:22:43.012077 run osmo-hlr_10.42.42.2(pid=21204): Launched 22:22:43.128389 run osmo-stp_10.42.42.5: Starting osmo-stp 22:22:43.665674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21206): Launched 22:22:43.970257 run osmo-stp_10.42.42.5(pid=21207): Launched 22:22:44.085598 run osmo-msc_10.42.42.6: Starting osmo-msc 22:22:44.633898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21209): Launched 22:22:44.938825 run osmo-msc_10.42.42.6(pid=21210): Launched 22:22:45.108813 run osmo-stp_10.42.42.5(pid=21207): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21207)] 22:22:45.239563 run osmo-stp_10.42.42.5(pid=21207): stdout: | (launched: 2022-12-08_22:22:43.915169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:45.368754 run osmo-stp_10.42.42.5(pid=21207): stderr: | 20221208222244086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222244086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222244086 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222244087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222244087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222244087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222244087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:45.495995 run osmo-stp_10.42.42.5(pid=21207): stdout: | (launched: 2022-12-08_22:22:43.915169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:45.617823 run osmo-stp_10.42.42.5(pid=21207): stderr: | 20221208222244086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222244086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222244086 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222244087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222244087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222244087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222244087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:45.763505 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21207): Process ended prematurely: osmo-stp_10.42.42.5(pid=21207) [trial-2350↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21207)] [trial-2350↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 22:22:45.772483 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:22:45.799638 run osmo-hlr_10.42.42.2(pid=21204): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21204)] 22:22:45.854910 run osmo-hlr_10.42.42.2(pid=21204): stdout: | (launched: 2022-12-08_22:22:42.957235) 22:22:45.910871 run osmo-hlr_10.42.42.2(pid=21204): stderr: | 20221208222243134 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222243134 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222243134 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222243135 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222243135 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222243135 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222243159 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222243169 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222243169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222243169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:22:45.986146 run osmo-msc_10.42.42.6(pid=21210): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21210)] 22:22:46.039889 run osmo-msc_10.42.42.6(pid=21210): stdout: | (launched: 2022-12-08_22:22:44.883327) 22:22:46.093700 run osmo-msc_10.42.42.6(pid=21210): stderr: | 20221208222245151 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208222245151 DLGLOBAL DEBUG validating counter group 0x7fa2b5d7bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208222245152 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208222245152 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208222245152 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208222245152 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208222245154 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208222245154 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208222245154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208222245154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:22:46.148238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21203): Terminating (SIGTERM) 22:22:46.193464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21206): Terminating (SIGTERM) 22:22:46.240566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21209): Terminating (SIGTERM) 22:22:46.287181 --- ParallelTerminationStrategy: PID 21203 died... 22:22:46.307932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21203): Terminated: ok {rc=0} 22:22:46.357756 --- ParallelTerminationStrategy: PID 21206 died... 22:22:46.378199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21206): Terminated: ok {rc=0} 22:22:46.428178 --- ParallelTerminationStrategy: PID 21209 died... 22:22:46.448893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21209): Terminated: ok {rc=0} 22:22:46.545138 bus /sierra_3: Setting Powered False 22:22:47.659235 bus /sierra_3: Setting Powered False 22:22:48.776732 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 22:22:49.927618 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:49.939714 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:22:50.011318 tst mo_mt_call_osmux.py: using LAC 17148 22:22:50.133049 tst mo_mt_call_osmux.py: using RAC 63 22:22:50.255338 tst mo_mt_call_osmux.py: using CellId 17148 22:22:50.377608 tst mo_mt_call_osmux.py: using BVCI 17149 22:22:50.491161 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:50.502114 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:50.512913 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:50.523843 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:50.534767 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:50.545836 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:22:50.659737 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:22:50.779235 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:22:51.284055 run create_hlr_db(pid=21212): Launched 22:22:51.415951 bus /sierra_2: Setting Powered False 22:22:52.479988 run create_hlr_db(pid=21212): Terminated: ok {rc=0} 22:22:52.914093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21214): Launched 22:22:53.217423 run osmo-hlr_10.42.42.2(pid=21215): Launched 22:22:53.333671 run osmo-stp_10.42.42.5: Starting osmo-stp 22:22:53.863226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21217): Launched 22:22:54.167256 run osmo-stp_10.42.42.5(pid=21218): Launched 22:22:54.282935 run osmo-msc_10.42.42.6: Starting osmo-msc 22:22:54.836763 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21220): Launched 22:22:55.142006 run osmo-msc_10.42.42.6(pid=21221): Launched 22:22:55.311735 run osmo-stp_10.42.42.5(pid=21218): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21218)] 22:22:55.441688 run osmo-stp_10.42.42.5(pid=21218): stdout: | (launched: 2022-12-08_22:22:54.112020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:55.571034 run osmo-stp_10.42.42.5(pid=21218): stderr: | 20221208222254284 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222254284 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222254284 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222254285 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222254285 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222254285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222254285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:55.698257 run osmo-stp_10.42.42.5(pid=21218): stdout: | (launched: 2022-12-08_22:22:54.112020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:55.819904 run osmo-stp_10.42.42.5(pid=21218): stderr: | 20221208222254284 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222254284 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222254284 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222254285 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222254285 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222254285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222254285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:55.965765 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21218): Process ended prematurely: osmo-stp_10.42.42.5(pid=21218) [trial-2350↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21218)] [trial-2350↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 22:22:55.974716 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:22:56.001945 run osmo-hlr_10.42.42.2(pid=21215): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21215)] 22:22:56.051137 run osmo-hlr_10.42.42.2(pid=21215): stdout: | (launched: 2022-12-08_22:22:53.162341) 22:22:56.102257 run osmo-hlr_10.42.42.2(pid=21215): stderr: | 20221208222253336 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222253336 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222253336 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222253336 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222253337 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222253337 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222253348 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222253358 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222253358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222253358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:22:56.173076 run osmo-msc_10.42.42.6(pid=21221): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21221)] 22:22:56.221947 run osmo-msc_10.42.42.6(pid=21221): stdout: | (launched: 2022-12-08_22:22:55.086403) 22:22:56.272318 run osmo-msc_10.42.42.6(pid=21221): stderr: | 20221208222255356 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208222255356 DLGLOBAL DEBUG validating counter group 0x7f4469360c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208222255356 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208222255356 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208222255356 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208222255357 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208222255358 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208222255359 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208222255359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208222255359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:22:56.323232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21214): Terminating (SIGTERM) 22:22:56.364090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21217): Terminating (SIGTERM) 22:22:56.404683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21220): Terminating (SIGTERM) 22:22:56.445715 --- ParallelTerminationStrategy: PID 21214 died... 22:22:56.465146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21214): Terminated: ok {rc=0} 22:22:56.510743 --- ParallelTerminationStrategy: PID 21217 died... 22:22:56.529652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21217): Terminated: ok {rc=0} 22:22:56.574949 --- ParallelTerminationStrategy: PID 21220 died... 22:22:56.593989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21220): Terminated: ok {rc=0} 22:22:56.682370 bus /sierra_3: Setting Powered False 22:22:57.782201 bus /sierra_3: Setting Powered False 22:22:58.898417 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 22:23:00.142731 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:23:00.148668 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 22:23:00.181317 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 22:23:00.207467 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 22:23:00.259238 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 22:23:00.292040 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 22:23:00.318257 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 22:23:00.877447 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 22:23:00.935082 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:00.947509 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:23:01.004016 tst mo_mt_call.py: using LAC 17149 22:23:01.190971 tst mo_mt_call.py: using RAC 64 22:23:01.354568 tst mo_mt_call.py: using CellId 17149 22:23:01.491842 tst mo_mt_call.py: using BVCI 17150 22:23:01.617319 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:01.629708 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:01.643031 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:01.656325 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:01.670219 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:01.682495 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:23:01.844663 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:23:02.016174 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:23:02.669772 run create_hlr_db(pid=21295): Launched 22:23:02.884027 bus /sierra_2: Setting Powered False 22:23:03.975102 run create_hlr_db(pid=21295): Terminated: ok {rc=0} 22:23:04.458025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21498): Launched 22:23:04.804571 run osmo-hlr_10.42.42.2(pid=21499): Launched 22:23:05.060671 run osmo-stp_10.42.42.5: Starting osmo-stp 22:23:05.732689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21501): Launched 22:23:06.077394 run osmo-stp_10.42.42.5(pid=21503): Launched 22:23:06.322258 run osmo-msc_10.42.42.6: Starting osmo-msc 22:23:07.009272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21506): Launched 22:23:07.352849 run osmo-msc_10.42.42.6(pid=21507): Launched 22:23:07.726923 run osmo-stp_10.42.42.5(pid=21503): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21503)] 22:23:08.000265 run osmo-stp_10.42.42.5(pid=21503): stdout: | (launched: 2022-12-08_22:23:06.015288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:08.172445 run osmo-stp_10.42.42.5(pid=21503): stderr: | 20221208222306300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222306301 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222306301 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222306301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222306303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222306304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222306304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:08.310860 run osmo-stp_10.42.42.5(pid=21503): stdout: | (launched: 2022-12-08_22:23:06.015288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:08.444057 run osmo-stp_10.42.42.5(pid=21503): stderr: | 20221208222306300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222306301 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222306301 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222306301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222306303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222306304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222306304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:08.601855 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21503): Process ended prematurely: osmo-stp_10.42.42.5(pid=21503) [trial-2350↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21503)] [trial-2350↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 22:23:08.613612 tst mo_mt_call.py:8: Test FAILED (7.7 sec) 22:23:08.642962 run osmo-hlr_10.42.42.2(pid=21499): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21499)] 22:23:08.696063 run osmo-hlr_10.42.42.2(pid=21499): stdout: | (launched: 2022-12-08_22:23:04.739757) 22:23:08.750296 run osmo-hlr_10.42.42.2(pid=21499): stderr: | 20221208222305050 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222305050 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222305050 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222305051 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222305051 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222305051 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222305071 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222305080 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222305080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222305080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:23:08.826918 run osmo-msc_10.42.42.6(pid=21507): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21507)] 22:23:08.879106 run osmo-msc_10.42.42.6(pid=21507): stdout: | (launched: 2022-12-08_22:23:07.289699) 22:23:08.933346 run osmo-msc_10.42.42.6(pid=21507): stderr: | 20221208222307788 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208222307788 DLGLOBAL DEBUG validating counter group 0x7f4784926c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208222307788 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208222307788 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208222307788 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208222307788 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208222307798 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208222307799 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208222307799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208222307799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:23:08.988712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21498): Terminating (SIGTERM) 22:23:09.033778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21501): Terminating (SIGTERM) 22:23:09.079726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21506): Terminating (SIGTERM) 22:23:09.125860 --- ParallelTerminationStrategy: PID 21498 died... 22:23:09.146734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21498): Terminated: ok {rc=0} 22:23:09.196586 --- ParallelTerminationStrategy: PID 21501 died... 22:23:09.218842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21501): Terminated: ok {rc=0} 22:23:09.267276 --- ParallelTerminationStrategy: PID 21506 died... 22:23:09.287915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21506): Terminated: ok {rc=0} 22:23:09.379690 bus /sierra_3: Setting Powered False 22:23:10.485280 bus /sierra_3: Setting Powered False 22:23:11.608441 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 22:23:12.766239 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:12.779536 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:23:12.834773 tst mo_mt_call_osmux.py: using LAC 17150 22:23:12.966101 tst mo_mt_call_osmux.py: using RAC 65 22:23:13.099829 tst mo_mt_call_osmux.py: using CellId 17150 22:23:13.231431 tst mo_mt_call_osmux.py: using BVCI 17151 22:23:13.353508 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:13.366265 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:13.379188 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:13.392132 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:13.406193 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:13.420179 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:23:13.543338 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:23:13.672096 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:23:14.200579 run create_hlr_db(pid=21509): Launched 22:23:14.356861 bus /sierra_2: Setting Powered False 22:23:15.423809 run create_hlr_db(pid=21509): Terminated: ok {rc=0} 22:23:15.913729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21511): Launched 22:23:16.277930 run osmo-hlr_10.42.42.2(pid=21512): Launched 22:23:16.529585 run osmo-stp_10.42.42.5: Starting osmo-stp 22:23:17.207014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21514): Launched 22:23:17.603662 run osmo-stp_10.42.42.5(pid=21515): Launched 22:23:17.886294 run osmo-msc_10.42.42.6: Starting osmo-msc 22:23:18.552744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21517): Launched 22:23:18.876769 run osmo-msc_10.42.42.6(pid=21518): Launched 22:23:19.225710 run osmo-stp_10.42.42.5(pid=21515): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21515)] 22:23:19.494067 run osmo-stp_10.42.42.5(pid=21515): stdout: | (launched: 2022-12-08_22:23:17.529464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:19.764229 run osmo-stp_10.42.42.5(pid=21515): stderr: | 20221208222317900 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222317900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222317900 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222317906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222317909 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222317909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222317909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:19.946941 run osmo-stp_10.42.42.5(pid=21515): stdout: | (launched: 2022-12-08_22:23:17.529464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:20.072242 run osmo-stp_10.42.42.5(pid=21515): stderr: | 20221208222317900 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222317900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222317900 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222317906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222317909 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222317909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222317909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:20.223206 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21515): Process ended prematurely: osmo-stp_10.42.42.5(pid=21515) [trial-2350↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21515)] [trial-2350↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 22:23:20.233259 tst mo_mt_call_osmux.py:8: Test FAILED (7.5 sec) 22:23:20.263822 run osmo-hlr_10.42.42.2(pid=21512): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21512)] 22:23:20.315562 run osmo-hlr_10.42.42.2(pid=21512): stdout: | (launched: 2022-12-08_22:23:16.208657) 22:23:20.369384 run osmo-hlr_10.42.42.2(pid=21512): stderr: | 20221208222316524 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222316524 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222316524 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222316525 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222316525 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222316525 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222316543 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222316557 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222316557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222316558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:23:20.443010 run osmo-msc_10.42.42.6(pid=21518): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21518)] 22:23:20.494443 run osmo-msc_10.42.42.6(pid=21518): stdout: | (launched: 2022-12-08_22:23:18.817807) 22:23:20.547429 run osmo-msc_10.42.42.6(pid=21518): stderr: | 20221208222319410 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208222319410 DLGLOBAL DEBUG validating counter group 0x7fb3d0505c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208222319410 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208222319411 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208222319411 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208222319411 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208222319413 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208222319413 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208222319413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208222319413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:23:20.601127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21511): Terminating (SIGTERM) 22:23:20.644537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21514): Terminating (SIGTERM) 22:23:20.689644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21517): Terminating (SIGTERM) 22:23:20.734973 --- ParallelTerminationStrategy: PID 21511 died... 22:23:20.755289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21511): Terminated: ok {rc=0} 22:23:20.805283 --- ParallelTerminationStrategy: PID 21514 died... 22:23:20.825346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21514): Terminated: ok {rc=0} 22:23:20.873632 --- ParallelTerminationStrategy: PID 21517 died... 22:23:20.893701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21517): Terminated: ok {rc=0} 22:23:20.982944 bus /sierra_3: Setting Powered False 22:23:22.084192 bus /sierra_3: Setting Powered False 22:23:23.202003 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 emergency:trx-umtrx --------------------------------------------------------------------- 22:23:24.453738 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:23:24.458982 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 22:23:24.495627 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 22:23:24.524811 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 22:23:24.608306 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 22:23:24.643908 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 22:23:24.672882 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 22:23:25.250421 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2350 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 22:23:25.256139 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:25.267238 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 22:23:25.318619 tst emergency_mo_mt_call.py: using LAC 17151 22:23:25.445493 tst emergency_mo_mt_call.py: using RAC 66 22:23:25.564475 tst emergency_mo_mt_call.py: using CellId 17151 22:23:25.682052 tst emergency_mo_mt_call.py: using BVCI 17152 22:23:25.793514 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:25.804018 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:25.814341 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:25.825554 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:25.836570 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:25.847560 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 22:23:25.967170 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 22:23:26.089531 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:23:26.583862 run create_hlr_db(pid=21524): Launched 22:23:26.713016 bus /sierra_2: Setting Powered False 22:23:27.776300 run create_hlr_db(pid=21524): Terminated: ok {rc=0} 22:23:28.203265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21526): Launched 22:23:28.501672 run osmo-hlr_10.42.42.2(pid=21527): Launched 22:23:28.616297 run osmo-stp_10.42.42.5: Starting osmo-stp 22:23:29.138315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21529): Launched 22:23:29.438251 run osmo-stp_10.42.42.5(pid=21530): Launched 22:23:29.562175 tst emergency_mo_mt_call.py: using MSISDN 6880 22:23:29.714958 run osmo-msc_10.42.42.6: Starting osmo-msc 22:23:30.252924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21532): Launched 22:23:30.553355 run osmo-msc_10.42.42.6(pid=21533): Launched 22:23:30.722348 run osmo-stp_10.42.42.5(pid=21530): ERR: Terminated: ERROR {rc=1} [trial-2350↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21530)] 22:23:30.859778 run osmo-stp_10.42.42.5(pid=21530): stdout: | (launched: 2022-12-08_22:23:29.383166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:31.093416 run osmo-stp_10.42.42.5(pid=21530): stderr: | 20221208222329551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222329552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222329552 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222329552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222329553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222329553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222329553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:31.233658 run osmo-stp_10.42.42.5(pid=21530): stdout: | (launched: 2022-12-08_22:23:29.383166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:31.365703 run osmo-stp_10.42.42.5(pid=21530): stderr: | 20221208222329551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222329552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222329552 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222329552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222329553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222329553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222329553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:31.525113 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=21530): Process ended prematurely: osmo-stp_10.42.42.5(pid=21530) [trial-2350↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21530)] [trial-2350↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 22:23:31.534840 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 22:23:31.563691 run osmo-hlr_10.42.42.2(pid=21527): ERR: Terminated: ERROR {rc=237} [trial-2350↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21527)] 22:23:31.617269 run osmo-hlr_10.42.42.2(pid=21527): stdout: | (launched: 2022-12-08_22:23:28.447688) 22:23:31.673513 run osmo-hlr_10.42.42.2(pid=21527): stderr: | 20221208222328624 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222328624 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222328624 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222328624 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222328624 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222328624 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222328636 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222328645 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222328645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222328645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:23:31.751129 run osmo-msc_10.42.42.6(pid=21533): ERR: Terminated: ERROR {rc=2} [trial-2350↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21533)] 22:23:31.804203 run osmo-msc_10.42.42.6(pid=21533): stdout: | (launched: 2022-12-08_22:23:30.498449) 22:23:31.860162 run osmo-msc_10.42.42.6(pid=21533): stderr: | 20221208222330769 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208222330769 DLGLOBAL DEBUG validating counter group 0x7f199ddf8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208222330769 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208222330769 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208222330769 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208222330770 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208222330771 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208222330772 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208222330772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208222330772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:23:31.915502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21526): Terminating (SIGTERM) 22:23:31.961225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21529): Terminating (SIGTERM) 22:23:32.006950 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21532): Terminating (SIGTERM) 22:23:32.053833 --- ParallelTerminationStrategy: PID 21526 died... 22:23:32.074487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21526): Terminated: ok {rc=0} 22:23:32.124315 --- ParallelTerminationStrategy: PID 21529 died... 22:23:32.145086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21529): Terminated: ok {rc=0} 22:23:32.192427 --- ParallelTerminationStrategy: PID 21532 died... 22:23:32.212872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21532): Terminated: ok {rc=0} 22:23:32.303299 bus /sierra_3: Setting Powered False 22:23:33.403297 bus /sierra_3: Setting Powered False 22:23:34.519352 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 22:23:35.603248 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:35.614578 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 22:23:35.664203 tst emergency_preemptive_call.py: using LAC 17152 22:23:35.789422 tst emergency_preemptive_call.py: using RAC 67 22:23:35.908098 tst emergency_preemptive_call.py: using CellId 17152 22:23:36.024542 tst emergency_preemptive_call.py: using BVCI 17153 22:23:36.134009 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:36.144491 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:36.154937 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:36.165607 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:36.176175 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:36.186797 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 22:23:36.304612 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 22:23:36.422722 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 22:23:36.536438 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 22:23:36.654020 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:23:37.152037 run create_hlr_db(pid=21535): Launched 22:23:37.282191 bus /sierra_2: Setting Powered False 22:23:38.346477 run create_hlr_db(pid=21535): Terminated: ok {rc=0} 22:23:38.793050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21537): Launched 22:23:39.112653 run osmo-hlr_10.42.42.2(pid=21538): Launched 22:23:39.234427 run osmo-stp_10.42.42.5: Starting osmo-stp 22:23:39.783964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21540): Launched 22:23:40.103534 run osmo-stp_10.42.42.5(pid=21541): Launched 22:23:40.234921 tst emergency_preemptive_call.py: using MSISDN 6881 22:23:40.399850 run osmo-msc_10.42.42.6: Starting osmo-msc 22:23:40.972341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21543): Launched 22:23:41.291422 run osmo-msc_10.42.42.6(pid=21544): Launched 22:23:41.469122 run osmo-stp_10.42.42.5(pid=21541): ERR: Terminated: ERROR {rc=1} [trial-2350↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21541)] 22:23:41.604447 run osmo-stp_10.42.42.5(pid=21541): stdout: | (launched: 2022-12-08_22:23:40.045350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:41.740329 run osmo-stp_10.42.42.5(pid=21541): stderr: | 20221208222340239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222340239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222340240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222340240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222340241 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222340241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222340241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:41.875340 run osmo-stp_10.42.42.5(pid=21541): stdout: | (launched: 2022-12-08_22:23:40.045350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:42.002736 run osmo-stp_10.42.42.5(pid=21541): stderr: | 20221208222340239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222340239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222340240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222340240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222340241 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222340241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222340241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:42.155751 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=21541): Process ended prematurely: osmo-stp_10.42.42.5(pid=21541) [trial-2350↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21541)] [trial-2350↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 22:23:42.164777 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 22:23:42.192410 run osmo-hlr_10.42.42.2(pid=21538): ERR: Terminated: ERROR {rc=237} [trial-2350↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21538)] 22:23:42.242888 run osmo-hlr_10.42.42.2(pid=21538): stdout: | (launched: 2022-12-08_22:23:39.054523) 22:23:42.295100 run osmo-hlr_10.42.42.2(pid=21538): stderr: | 20221208222339253 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222339253 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222339253 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222339253 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222339253 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222339253 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222339265 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222339273 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222339273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222339273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:23:42.367983 run osmo-msc_10.42.42.6(pid=21544): ERR: Terminated: ERROR {rc=2} [trial-2350↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21544)] 22:23:42.418532 run osmo-msc_10.42.42.6(pid=21544): stdout: | (launched: 2022-12-08_22:23:41.233787) 22:23:42.470897 run osmo-msc_10.42.42.6(pid=21544): stderr: | 20221208222341555 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208222341555 DLGLOBAL DEBUG validating counter group 0x7fd0fab52c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208222341555 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208222341555 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208222341555 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208222341555 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208222341557 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208222341558 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208222341558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208222341558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:23:42.523294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21537): Terminating (SIGTERM) 22:23:42.565226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21540): Terminating (SIGTERM) 22:23:42.608324 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21543): Terminating (SIGTERM) 22:23:42.651426 --- ParallelTerminationStrategy: PID 21537 died... 22:23:42.672383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21537): Terminated: ok {rc=0} 22:23:42.721568 --- ParallelTerminationStrategy: PID 21540 died... 22:23:42.741825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21540): Terminated: ok {rc=0} 22:23:42.789801 --- ParallelTerminationStrategy: PID 21543 died... 22:23:42.809576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21543): Terminated: ok {rc=0} 22:23:42.898272 bus /sierra_9: Setting Powered False 22:23:43.997955 bus /sierra_9: Setting Powered False 22:23:45.114739 bus /sierra_8: Setting Powered False 22:23:46.219767 bus /sierra_8: Setting Powered False 22:23:47.335917 bus /sierra_3: Setting Powered False 22:23:48.434599 bus /sierra_3: Setting Powered False 22:23:49.551728 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:trx-umtrx --------------------------------------------------------------------- 22:23:50.828349 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:23:50.832882 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 22:23:50.865890 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 22:23:50.905097 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 22:23:50.992836 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 22:23:51.025903 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 22:23:51.065389 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 22:23:51.654970 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 22:23:51.707710 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:51.718691 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 22:23:51.767357 tst cs_paging_gprs_active.py: using LAC 17153 22:23:51.895603 tst cs_paging_gprs_active.py: using RAC 68 22:23:52.022633 tst cs_paging_gprs_active.py: using CellId 17153 22:23:52.150788 tst cs_paging_gprs_active.py: using BVCI 17154 22:23:52.270705 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:52.281772 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:52.292457 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:52.303310 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:52.314075 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:52.324663 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:52.335632 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:52.346395 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:52.357263 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:23:52.472600 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:23:52.587174 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:23:52.792472 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:23:53.098355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21550): Launched 22:23:53.365092 run iperf3-srv_10.42.42.10(pid=21551): Launched 22:23:53.480342 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:23:53.684499 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:23:53.991332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21552): Launched 22:23:54.257312 run iperf3-srv_10.42.42.10(pid=21553): Launched 22:23:54.371772 tst cs_paging_gprs_active.py:38: start network... 22:23:54.576249 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:23:55.049361 run create_hlr_db(pid=21554): Launched 22:23:55.183795 bus /sierra_2: Setting Powered False 22:23:56.247904 run create_hlr_db(pid=21554): Terminated: ok {rc=0} 22:23:56.689098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21556): Launched 22:23:56.994529 run osmo-hlr_10.42.42.2(pid=21557): Launched 22:23:57.111051 run osmo-stp_10.42.42.5: Starting osmo-stp 22:23:57.653630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21559): Launched 22:23:57.960200 run osmo-stp_10.42.42.5(pid=21560): Launched 22:23:58.077105 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:23:58.604537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21562): Launched 22:23:58.721362 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:23:58.978911 run patchelf(pid=21563): Launched 22:23:59.148729 run osmo-stp_10.42.42.5(pid=21560): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21560)] 22:23:59.278707 run osmo-stp_10.42.42.5(pid=21560): stdout: | (launched: 2022-12-08_22:23:57.904374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:59.410309 run osmo-stp_10.42.42.5(pid=21560): stderr: | 20221208222358074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222358075 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222358075 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222358075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222358076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222358076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222358076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:59.541798 run osmo-stp_10.42.42.5(pid=21560): stdout: | (launched: 2022-12-08_22:23:57.904374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:59.667943 run osmo-stp_10.42.42.5(pid=21560): stderr: | 20221208222358074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222358075 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222358075 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222358075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222358076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222358076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222358076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:59.817469 run patchelf(pid=21563): Terminating (SIGINT) 22:23:59.989356 run patchelf(pid=21563): Terminated: ok {rc=0} 22:24:00.113579 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21560): Process ended prematurely: osmo-stp_10.42.42.5(pid=21560) [trial-2350↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21560)] [trial-2350↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 22:24:00.123046 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 22:24:00.151342 run osmo-hlr_10.42.42.2(pid=21557): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21557)] 22:24:00.200396 run osmo-hlr_10.42.42.2(pid=21557): stdout: | (launched: 2022-12-08_22:23:56.939061) 22:24:00.251561 run osmo-hlr_10.42.42.2(pid=21557): stderr: | 20221208222357115 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222357115 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222357115 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222357115 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222357115 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222357115 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222357127 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222357137 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222357137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222357137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:24:00.302896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21550): Terminating (SIGTERM) 22:24:00.344131 run iperf3-srv_10.42.42.10(pid=21551): Terminating (SIGTERM) 22:24:00.385062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21552): Terminating (SIGTERM) 22:24:00.425624 run iperf3-srv_10.42.42.10(pid=21553): Terminating (SIGTERM) 22:24:00.466527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21556): Terminating (SIGTERM) 22:24:00.507849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21559): Terminating (SIGTERM) 22:24:00.548800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21562): Terminating (SIGTERM) 22:24:00.590250 --- ParallelTerminationStrategy: PID 21550 died... 22:24:00.609708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21550): Terminated: ok {rc=0} 22:24:00.655183 --- ParallelTerminationStrategy: PID 21551 died... 22:24:00.674152 run iperf3-srv_10.42.42.10(pid=21551): Terminated {rc=256} 22:24:00.720035 --- ParallelTerminationStrategy: PID 21552 died... 22:24:00.739013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21552): Terminated: ok {rc=0} 22:24:00.784403 --- ParallelTerminationStrategy: PID 21553 died... 22:24:00.803250 run iperf3-srv_10.42.42.10(pid=21553): Terminated {rc=256} 22:24:00.860480 --- ParallelTerminationStrategy: PID 21556 died... 22:24:00.880487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21556): Terminated: ok {rc=0} 22:24:00.930687 --- ParallelTerminationStrategy: PID 21559 died... 22:24:00.950156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21559): Terminated: ok {rc=0} 22:24:00.996340 --- ParallelTerminationStrategy: PID 21562 died... 22:24:01.015998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21562): Terminated: ok {rc=0} 22:24:01.103297 bus /gobi_0: Setting Powered False 22:24:02.204277 bus /gobi_0: Setting Powered False 22:24:03.330923 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-umtrx iperf3.py ---------------------------------------------- 22:24:04.475488 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:04.486654 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 22:24:04.536747 tst iperf3.py: using LAC 17154 22:24:04.657423 tst iperf3.py: using RAC 69 22:24:04.786823 tst iperf3.py: using CellId 17154 22:24:04.916880 tst iperf3.py: using BVCI 17155 22:24:05.035892 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:05.047185 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:05.058311 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:05.069159 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:05.079839 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:05.090597 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:05.101631 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:05.112697 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:05.123664 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:24:05.238798 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:24:05.445321 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:24:05.752535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21564): Launched 22:24:06.019329 run iperf3-srv_10.42.42.10(pid=21565): Launched 22:24:06.133939 tst iperf3.py:8: start network... 22:24:06.338549 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:24:06.810272 run create_hlr_db(pid=21566): Launched 22:24:06.927517 bus /gobi_6: Setting Powered False 22:24:07.988336 run create_hlr_db(pid=21566): Terminated: ok {rc=0} 22:24:08.434350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21568): Launched 22:24:08.761442 run osmo-hlr_10.42.42.2(pid=21569): Launched 22:24:08.886218 run osmo-stp_10.42.42.5: Starting osmo-stp 22:24:09.451321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21571): Launched 22:24:09.776325 run osmo-stp_10.42.42.5(pid=21572): Launched 22:24:09.900267 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:24:10.463244 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21574): Launched 22:24:10.588173 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:24:10.863810 run patchelf(pid=21575): Launched 22:24:11.045455 run osmo-stp_10.42.42.5(pid=21572): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21572)] 22:24:11.184319 run osmo-stp_10.42.42.5(pid=21572): stdout: | (launched: 2022-12-08_22:24:09.717710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:11.324092 run osmo-stp_10.42.42.5(pid=21572): stderr: | 20221208222409912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222409912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222409913 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222409913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222409913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222409913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222409914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:11.464041 run osmo-stp_10.42.42.5(pid=21572): stdout: | (launched: 2022-12-08_22:24:09.717710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:11.598959 run osmo-stp_10.42.42.5(pid=21572): stderr: | 20221208222409912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222409912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222409913 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222409913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222409913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222409913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222409914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:11.758227 run patchelf(pid=21575): Terminating (SIGINT) 22:24:11.941601 run patchelf(pid=21575): Terminated: ok {rc=0} 22:24:12.073760 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21572): Process ended prematurely: osmo-stp_10.42.42.5(pid=21572) [trial-2350↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21572)] [trial-2350↪gprs:trx-umtrx↪iperf3.py:8] 22:24:12.083821 tst iperf3.py:8: Test FAILED (7.6 sec) 22:24:12.113155 run osmo-hlr_10.42.42.2(pid=21569): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21569)] 22:24:12.164277 run osmo-hlr_10.42.42.2(pid=21569): stdout: | (launched: 2022-12-08_22:24:08.702586) 22:24:12.216781 run osmo-hlr_10.42.42.2(pid=21569): stderr: | 20221208222408899 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222408899 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222408899 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222408899 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222408899 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222408900 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222408921 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222408931 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222408931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222408932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:24:12.269782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21564): Terminating (SIGTERM) 22:24:12.312258 run iperf3-srv_10.42.42.10(pid=21565): Terminating (SIGTERM) 22:24:12.354953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21568): Terminating (SIGTERM) 22:24:12.397598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21571): Terminating (SIGTERM) 22:24:12.440035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21574): Terminating (SIGTERM) 22:24:12.482789 --- ParallelTerminationStrategy: PID 21564 died... 22:24:12.503043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21564): Terminated: ok {rc=0} 22:24:12.550324 --- ParallelTerminationStrategy: PID 21565 died... 22:24:12.570164 run iperf3-srv_10.42.42.10(pid=21565): Terminated {rc=256} 22:24:12.617016 --- ParallelTerminationStrategy: PID 21568 died... 22:24:12.636932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21568): Terminated: ok {rc=0} 22:24:12.683963 --- ParallelTerminationStrategy: PID 21571 died... 22:24:12.703831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21571): Terminated: ok {rc=0} 22:24:12.751019 --- ParallelTerminationStrategy: PID 21574 died... 22:24:12.770917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21574): Terminated: ok {rc=0} 22:24:12.859358 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 22:24:14.012110 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:14.023624 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 22:24:14.073329 tst iperf3m4.py: using LAC 17155 22:24:14.203367 tst iperf3m4.py: using RAC 70 22:24:14.336316 tst iperf3m4.py: using CellId 17155 22:24:14.464230 tst iperf3m4.py: using BVCI 17156 22:24:14.578786 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:14.589981 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:14.600406 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:14.611353 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:14.622218 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:14.632852 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:14.643570 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:14.654387 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:14.665342 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:24:14.783708 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:24:14.904581 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:24:15.021828 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:24:15.142426 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:24:15.362744 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:24:15.690292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21576): Launched 22:24:15.993305 run iperf3-srv_10.42.42.10(pid=21577): Launched 22:24:16.126612 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:24:16.338841 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:24:16.663520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21578): Launched 22:24:16.956359 run iperf3-srv_10.42.42.10(pid=21579): Launched 22:24:17.123703 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:24:17.342948 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:24:17.670390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21580): Launched 22:24:17.952777 run iperf3-srv_10.42.42.10(pid=21583): Launched 22:24:18.075000 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:24:18.295248 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:24:18.621983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21584): Launched 22:24:18.904329 run iperf3-srv_10.42.42.10(pid=21585): Launched 22:24:19.026226 tst iperf3m4.py:8: start network... 22:24:19.246041 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:24:19.752082 run create_hlr_db(pid=21586): Launched 22:24:19.884186 bus /gobi_6: Setting Powered False 22:24:20.948329 run create_hlr_db(pid=21586): Terminated: ok {rc=0} 22:24:21.401794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21588): Launched 22:24:21.727070 run osmo-hlr_10.42.42.2(pid=21589): Launched 22:24:21.850817 run osmo-stp_10.42.42.5: Starting osmo-stp 22:24:22.418830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21591): Launched 22:24:22.744778 run osmo-stp_10.42.42.5(pid=21592): Launched 22:24:22.869242 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:24:23.433437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21594): Launched 22:24:23.558712 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:24:23.835311 run patchelf(pid=21595): Launched 22:24:24.017130 run osmo-stp_10.42.42.5(pid=21592): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21592)] 22:24:24.156131 run osmo-stp_10.42.42.5(pid=21592): stdout: | (launched: 2022-12-08_22:24:22.685816) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:24.295930 run osmo-stp_10.42.42.5(pid=21592): stderr: | 20221208222422880 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222422881 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222422881 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222422881 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222422882 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222422882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222422882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:24.435709 run osmo-stp_10.42.42.5(pid=21592): stdout: | (launched: 2022-12-08_22:24:22.685816) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:24.570054 run osmo-stp_10.42.42.5(pid=21592): stderr: | 20221208222422880 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222422881 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222422881 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222422881 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222422882 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222422882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222422882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:24.729152 run patchelf(pid=21595): Terminating (SIGINT) 22:24:24.912242 run patchelf(pid=21595): Terminated: ok {rc=0} 22:24:25.044109 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21592): Process ended prematurely: osmo-stp_10.42.42.5(pid=21592) [trial-2350↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21592)] [trial-2350↪gprs:trx-umtrx↪iperf3m4.py:8] 22:24:25.054314 tst iperf3m4.py:8: Test FAILED (11.1 sec) 22:24:25.083398 run osmo-hlr_10.42.42.2(pid=21589): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21589)] 22:24:25.134941 run osmo-hlr_10.42.42.2(pid=21589): stdout: | (launched: 2022-12-08_22:24:21.668088) 22:24:25.187790 run osmo-hlr_10.42.42.2(pid=21589): stderr: | 20221208222421869 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222421869 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222421869 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222421869 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222421869 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222421869 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222421882 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222421890 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222421891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222421891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:24:25.240891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21576): Terminating (SIGTERM) 22:24:25.283522 run iperf3-srv_10.42.42.10(pid=21577): Terminating (SIGTERM) 22:24:25.326228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21578): Terminating (SIGTERM) 22:24:25.369055 run iperf3-srv_10.42.42.10(pid=21579): Terminating (SIGTERM) 22:24:25.411729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21580): Terminating (SIGTERM) 22:24:25.454580 run iperf3-srv_10.42.42.10(pid=21583): Terminating (SIGTERM) 22:24:25.497128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21584): Terminating (SIGTERM) 22:24:25.539800 run iperf3-srv_10.42.42.10(pid=21585): Terminating (SIGTERM) 22:24:25.582826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21588): Terminating (SIGTERM) 22:24:25.625584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21591): Terminating (SIGTERM) 22:24:25.669690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21594): Terminating (SIGTERM) 22:24:25.712522 --- ParallelTerminationStrategy: PID 21576 died... 22:24:25.732828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21576): Terminated: ok {rc=0} 22:24:25.780009 --- ParallelTerminationStrategy: PID 21577 died... 22:24:25.799851 run iperf3-srv_10.42.42.10(pid=21577): Terminated {rc=256} 22:24:25.846832 --- ParallelTerminationStrategy: PID 21578 died... 22:24:25.866554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21578): Terminated: ok {rc=0} 22:24:25.913820 --- ParallelTerminationStrategy: PID 21579 died... 22:24:25.933654 run iperf3-srv_10.42.42.10(pid=21579): Terminated {rc=256} 22:24:25.980927 --- ParallelTerminationStrategy: PID 21580 died... 22:24:26.001205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21580): Terminated: ok {rc=0} 22:24:26.048032 --- ParallelTerminationStrategy: PID 21583 died... 22:24:26.067761 run iperf3-srv_10.42.42.10(pid=21583): Terminated {rc=256} 22:24:26.115468 --- ParallelTerminationStrategy: PID 21584 died... 22:24:26.135307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21584): Terminated: ok {rc=0} 22:24:26.182452 --- ParallelTerminationStrategy: PID 21585 died... 22:24:26.202171 run iperf3-srv_10.42.42.10(pid=21585): Terminated {rc=256} 22:24:26.249282 --- ParallelTerminationStrategy: PID 21588 died... 22:24:26.268938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21588): Terminated: ok {rc=0} 22:24:26.316088 --- ParallelTerminationStrategy: PID 21591 died... 22:24:26.336038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21591): Terminated: ok {rc=0} 22:24:26.383132 --- ParallelTerminationStrategy: PID 21594 died... 22:24:26.403097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21594): Terminated: ok {rc=0} 22:24:26.491787 bus /gobi_4: Setting Powered False 22:24:27.592831 bus /gobi_4: Setting Powered False 22:24:28.712110 bus /gobi_1: Setting Powered False 22:24:29.813286 bus /gobi_1: Setting Powered False 22:24:30.948216 bus /gobi_0: Setting Powered False 22:24:32.071719 bus /gobi_0: Setting Powered False 22:24:33.190053 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-umtrx ping.py ---------------------------------------------- 22:24:34.291274 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:34.302431 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 22:24:34.354052 tst ping.py: using LAC 17156 22:24:34.472091 tst ping.py: using RAC 71 22:24:34.589133 tst ping.py: using CellId 17156 22:24:34.706412 tst ping.py: using BVCI 17157 22:24:34.815858 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:34.826487 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:34.836817 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:34.847443 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:34.857909 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:34.868435 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:34.879075 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:34.889734 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:24:35.006888 tst ping.py:19: start network... 22:24:35.224110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:24:35.720077 run create_hlr_db(pid=21596): Launched 22:24:35.850159 bus /gobi_6: Setting Powered False 22:24:36.913710 run create_hlr_db(pid=21596): Terminated: ok {rc=0} 22:24:37.341851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21598): Launched 22:24:37.643257 run osmo-hlr_10.42.42.2(pid=21599): Launched 22:24:37.756301 run osmo-stp_10.42.42.5: Starting osmo-stp 22:24:38.292820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21601): Launched 22:24:38.591658 run osmo-stp_10.42.42.5(pid=21602): Launched 22:24:38.705835 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:24:39.223605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21604): Launched 22:24:39.338334 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:24:39.591097 run patchelf(pid=21605): Launched 22:24:39.758702 run osmo-stp_10.42.42.5(pid=21602): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21602)] 22:24:39.886806 run osmo-stp_10.42.42.5(pid=21602): stdout: | (launched: 2022-12-08_22:24:38.537168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:40.016062 run osmo-stp_10.42.42.5(pid=21602): stderr: | 20221208222438706 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222438706 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222438706 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222438706 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222438709 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222438709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222438709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:40.145465 run osmo-stp_10.42.42.5(pid=21602): stdout: | (launched: 2022-12-08_22:24:38.537168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:40.269178 run osmo-stp_10.42.42.5(pid=21602): stderr: | 20221208222438706 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222438706 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222438706 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222438706 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222438709 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222438709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222438709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:40.415114 run patchelf(pid=21605): Terminating (SIGINT) 22:24:40.584164 run patchelf(pid=21605): Terminated: ok {rc=0} 22:24:40.706387 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21602): Process ended prematurely: osmo-stp_10.42.42.5(pid=21602) [trial-2350↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21602)] [trial-2350↪gprs:trx-umtrx↪ping.py:22] 22:24:40.715157 tst ping.py:22: Test FAILED (6.4 sec) 22:24:40.742677 run osmo-hlr_10.42.42.2(pid=21599): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21599)] 22:24:40.791551 run osmo-hlr_10.42.42.2(pid=21599): stdout: | (launched: 2022-12-08_22:24:37.588356) 22:24:40.842117 run osmo-hlr_10.42.42.2(pid=21599): stderr: | 20221208222437766 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222437766 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222437767 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222437767 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222437767 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222437767 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222437780 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222437790 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222437790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222437791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:24:40.893055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21598): Terminating (SIGTERM) 22:24:40.933580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21601): Terminating (SIGTERM) 22:24:40.974215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21604): Terminating (SIGTERM) 22:24:41.015167 --- ParallelTerminationStrategy: PID 21598 died... 22:24:41.034484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21598): Terminated: ok {rc=0} 22:24:41.079770 --- ParallelTerminationStrategy: PID 21601 died... 22:24:41.098911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21601): Terminated: ok {rc=0} 22:24:41.144279 --- ParallelTerminationStrategy: PID 21604 died... 22:24:41.163186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21604): Terminated: ok {rc=0} 22:24:41.248298 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 22:24:42.336213 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:42.348210 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 22:24:42.400605 tst ping_idle_ping.py: using LAC 17157 22:24:42.529653 tst ping_idle_ping.py: using RAC 72 22:24:42.657086 tst ping_idle_ping.py: using CellId 17157 22:24:42.784216 tst ping_idle_ping.py: using BVCI 17158 22:24:42.901934 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:42.913184 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:42.924231 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:42.935614 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:42.947100 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:42.958449 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:42.969938 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:42.981417 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:24:43.098569 tst ping_idle_ping.py:24: start network... 22:24:43.316279 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:24:43.815218 run create_hlr_db(pid=21606): Launched 22:24:43.945416 bus /gobi_6: Setting Powered False 22:24:45.009283 run create_hlr_db(pid=21606): Terminated: ok {rc=0} 22:24:45.440593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21608): Launched 22:24:45.744348 run osmo-hlr_10.42.42.2(pid=21609): Launched 22:24:45.907307 run osmo-stp_10.42.42.5: Starting osmo-stp 22:24:46.537786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21611): Launched 22:24:46.857794 run osmo-stp_10.42.42.5(pid=21612): Launched 22:24:47.131353 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:24:47.709909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21614): Launched 22:24:47.825620 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:24:48.079414 run patchelf(pid=21615): Launched 22:24:48.247770 run osmo-stp_10.42.42.5(pid=21612): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21612)] 22:24:48.375793 run osmo-stp_10.42.42.5(pid=21612): stdout: | (launched: 2022-12-08_22:24:46.796865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:48.505610 run osmo-stp_10.42.42.5(pid=21612): stderr: | 20221208222447072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222447073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222447073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222447073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222447075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222447076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222447076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:48.635575 run osmo-stp_10.42.42.5(pid=21612): stdout: | (launched: 2022-12-08_22:24:46.796865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:48.760091 run osmo-stp_10.42.42.5(pid=21612): stderr: | 20221208222447072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222447073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222447073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222447073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222447075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222447076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222447076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:48.906835 run patchelf(pid=21615): Terminating (SIGINT) 22:24:49.075998 run patchelf(pid=21615): Terminated: ok {rc=0} 22:24:49.198337 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21612): Process ended prematurely: osmo-stp_10.42.42.5(pid=21612) [trial-2350↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21612)] [trial-2350↪gprs:trx-umtrx↪ping_idle_ping.py:27] 22:24:49.207206 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 22:24:49.234885 run osmo-hlr_10.42.42.2(pid=21609): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21609)] 22:24:49.283983 run osmo-hlr_10.42.42.2(pid=21609): stdout: | (launched: 2022-12-08_22:24:45.688016) 22:24:49.334777 run osmo-hlr_10.42.42.2(pid=21609): stderr: | 20221208222445907 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222445907 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222445907 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222445907 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222445908 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222445908 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222445933 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222445954 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222445954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222445954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:24:49.386113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21608): Terminating (SIGTERM) 22:24:49.426857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21611): Terminating (SIGTERM) 22:24:49.467628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21614): Terminating (SIGTERM) 22:24:49.508691 --- ParallelTerminationStrategy: PID 21608 died... 22:24:49.528155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21608): Terminated: ok {rc=0} 22:24:49.573567 --- ParallelTerminationStrategy: PID 21611 died... 22:24:49.592526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21611): Terminated: ok {rc=0} 22:24:49.638060 --- ParallelTerminationStrategy: PID 21614 died... 22:24:49.657430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21614): Terminated: ok {rc=0} 22:24:49.746472 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 22:24:51.052457 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:24:51.058263 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:24:51.091244 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:24:51.130913 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:24:51.219328 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:24:51.252542 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:24:51.291934 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:24:51.887660 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:24:51.939839 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:51.951087 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:24:52.002044 tst cs_paging_gprs_active.py: using LAC 17158 22:24:52.124177 tst cs_paging_gprs_active.py: using RAC 73 22:24:52.246686 tst cs_paging_gprs_active.py: using CellId 17158 22:24:52.369177 tst cs_paging_gprs_active.py: using BVCI 17159 22:24:52.481075 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:52.492097 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:52.502977 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:52.514106 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:52.525069 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:52.535960 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:52.547103 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:52.558198 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:52.569522 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:24:52.688917 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:24:52.803909 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:24:53.009908 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:24:53.317327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21619): Launched 22:24:53.584007 run iperf3-srv_10.42.42.10(pid=21620): Launched 22:24:53.699262 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:24:53.905375 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:24:54.212541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21621): Launched 22:24:54.479107 run iperf3-srv_10.42.42.10(pid=21622): Launched 22:24:54.594666 tst cs_paging_gprs_active.py:38: start network... 22:24:54.800374 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:24:55.275273 run create_hlr_db(pid=21623): Launched 22:24:55.391834 bus /gobi_6: Setting Powered False 22:24:56.454111 run create_hlr_db(pid=21623): Terminated: ok {rc=0} 22:24:56.899796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21625): Launched 22:24:57.225926 run osmo-hlr_10.42.42.2(pid=21626): Launched 22:24:57.350422 run osmo-stp_10.42.42.5: Starting osmo-stp 22:24:57.913420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21628): Launched 22:24:58.242459 run osmo-stp_10.42.42.5(pid=21629): Launched 22:24:58.366853 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:24:58.928839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21631): Launched 22:24:59.053424 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:24:59.329136 run patchelf(pid=21632): Launched 22:24:59.510860 run osmo-stp_10.42.42.5(pid=21629): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21629)] 22:24:59.649463 run osmo-stp_10.42.42.5(pid=21629): stdout: | (launched: 2022-12-08_22:24:58.182425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:59.789800 run osmo-stp_10.42.42.5(pid=21629): stderr: | 20221208222458376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222458376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222458377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222458377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222458377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222458377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222458378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:59.930740 run osmo-stp_10.42.42.5(pid=21629): stdout: | (launched: 2022-12-08_22:24:58.182425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:00.065889 run osmo-stp_10.42.42.5(pid=21629): stderr: | 20221208222458376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222458376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222458377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222458377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222458377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222458377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222458378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:00.226632 run patchelf(pid=21632): Terminating (SIGINT) 22:25:00.409954 run patchelf(pid=21632): Terminated: ok {rc=0} 22:25:00.542235 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21629): Process ended prematurely: osmo-stp_10.42.42.5(pid=21629) [trial-2350↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21629)] [trial-2350↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:25:00.552416 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:25:00.581541 run osmo-hlr_10.42.42.2(pid=21626): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21626)] 22:25:00.632229 run osmo-hlr_10.42.42.2(pid=21626): stdout: | (launched: 2022-12-08_22:24:57.167222) 22:25:00.684747 run osmo-hlr_10.42.42.2(pid=21626): stderr: | 20221208222457365 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222457365 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222457365 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222457365 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222457366 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222457366 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222457378 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222457386 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222457386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222457386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:25:00.737625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21619): Terminating (SIGTERM) 22:25:00.779982 run iperf3-srv_10.42.42.10(pid=21620): Terminating (SIGTERM) 22:25:00.822272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21621): Terminating (SIGTERM) 22:25:00.880614 run iperf3-srv_10.42.42.10(pid=21622): Terminating (SIGTERM) 22:25:00.925423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21625): Terminating (SIGTERM) 22:25:00.968550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21628): Terminating (SIGTERM) 22:25:01.014941 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21631): Terminating (SIGTERM) 22:25:01.061721 --- ParallelTerminationStrategy: PID 21619 died... 22:25:01.082417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21619): Terminated: ok {rc=0} 22:25:01.130600 --- ParallelTerminationStrategy: PID 21620 died... 22:25:01.158270 run iperf3-srv_10.42.42.10(pid=21620): Terminated {rc=256} 22:25:01.207628 --- ParallelTerminationStrategy: PID 21621 died... 22:25:01.227606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21621): Terminated: ok {rc=0} 22:25:01.276758 --- ParallelTerminationStrategy: PID 21622 died... 22:25:01.296659 run iperf3-srv_10.42.42.10(pid=21622): Terminated {rc=256} 22:25:01.345932 --- ParallelTerminationStrategy: PID 21625 died... 22:25:01.366000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21625): Terminated: ok {rc=0} 22:25:01.414251 --- ParallelTerminationStrategy: PID 21628 died... 22:25:01.434103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21628): Terminated: ok {rc=0} 22:25:01.484413 --- ParallelTerminationStrategy: PID 21631 died... 22:25:01.504296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21631): Terminated: ok {rc=0} 22:25:01.598153 bus /gobi_0: Setting Powered False 22:25:02.709520 bus /gobi_0: Setting Powered False 22:25:03.825606 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:25:04.972180 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:04.983696 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:25:05.040713 tst iperf3.py: using LAC 17159 22:25:05.170983 tst iperf3.py: using RAC 74 22:25:05.299769 tst iperf3.py: using CellId 17159 22:25:05.428136 tst iperf3.py: using BVCI 17160 22:25:05.548804 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:05.560229 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:05.571288 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:05.582497 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:05.593493 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:05.604424 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:05.615658 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:05.626648 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:05.637900 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:25:05.751684 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:25:05.958369 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:25:06.266686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21636): Launched 22:25:06.533132 run iperf3-srv_10.42.42.10(pid=21637): Launched 22:25:06.656263 tst iperf3.py:8: start network... 22:25:06.877141 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:25:07.383234 run create_hlr_db(pid=21638): Launched 22:25:07.515219 bus /gobi_6: Setting Powered False 22:25:08.579903 run create_hlr_db(pid=21638): Terminated: ok {rc=0} 22:25:09.030459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21640): Launched 22:25:09.356663 run osmo-hlr_10.42.42.2(pid=21641): Launched 22:25:09.481649 run osmo-stp_10.42.42.5: Starting osmo-stp 22:25:10.053793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21643): Launched 22:25:10.378213 run osmo-stp_10.42.42.5(pid=21644): Launched 22:25:10.501589 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:25:11.062329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21646): Launched 22:25:11.186953 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:25:11.461998 run patchelf(pid=21647): Launched 22:25:11.642612 run osmo-stp_10.42.42.5(pid=21644): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21644)] 22:25:11.780383 run osmo-stp_10.42.42.5(pid=21644): stdout: | (launched: 2022-12-08_22:25:10.319684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:11.919804 run osmo-stp_10.42.42.5(pid=21644): stderr: | 20221208222510511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222510511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222510511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222510511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222510514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222510514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222510514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:12.059724 run osmo-stp_10.42.42.5(pid=21644): stdout: | (launched: 2022-12-08_22:25:10.319684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:12.194501 run osmo-stp_10.42.42.5(pid=21644): stderr: | 20221208222510511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222510511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222510511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222510511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222510514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222510514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222510514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:12.353283 run patchelf(pid=21647): Terminating (SIGINT) 22:25:12.536202 run patchelf(pid=21647): Terminated: ok {rc=0} 22:25:12.667944 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21644): Process ended prematurely: osmo-stp_10.42.42.5(pid=21644) [trial-2350↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21644)] [trial-2350↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 22:25:12.678170 tst iperf3.py:8: Test FAILED (7.7 sec) 22:25:12.706962 run osmo-hlr_10.42.42.2(pid=21641): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21641)] 22:25:12.757584 run osmo-hlr_10.42.42.2(pid=21641): stdout: | (launched: 2022-12-08_22:25:09.297718) 22:25:12.809848 run osmo-hlr_10.42.42.2(pid=21641): stderr: | 20221208222509497 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222509498 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222509498 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222509498 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222509498 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222509498 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222509510 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222509518 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222509518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222509518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:25:12.862608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21636): Terminating (SIGTERM) 22:25:12.904828 run iperf3-srv_10.42.42.10(pid=21637): Terminating (SIGTERM) 22:25:12.947010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21640): Terminating (SIGTERM) 22:25:12.989540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21643): Terminating (SIGTERM) 22:25:13.031557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21646): Terminating (SIGTERM) 22:25:13.074284 --- ParallelTerminationStrategy: PID 21636 died... 22:25:13.094518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21636): Terminated: ok {rc=0} 22:25:13.141892 --- ParallelTerminationStrategy: PID 21637 died... 22:25:13.161625 run iperf3-srv_10.42.42.10(pid=21637): Terminated {rc=256} 22:25:13.208315 --- ParallelTerminationStrategy: PID 21640 died... 22:25:13.228247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21640): Terminated: ok {rc=0} 22:25:13.274470 --- ParallelTerminationStrategy: PID 21643 died... 22:25:13.294068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21643): Terminated: ok {rc=0} 22:25:13.341137 --- ParallelTerminationStrategy: PID 21646 died... 22:25:13.360916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21646): Terminated: ok {rc=0} 22:25:13.449273 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:25:14.600728 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:14.612436 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:25:14.662703 tst iperf3m4.py: using LAC 17160 22:25:14.793032 tst iperf3m4.py: using RAC 75 22:25:14.927397 tst iperf3m4.py: using CellId 17160 22:25:15.055231 tst iperf3m4.py: using BVCI 17161 22:25:15.175236 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:15.186693 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:15.197740 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:15.209383 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:15.220716 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:15.232304 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:15.243992 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:15.255412 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:15.267073 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:25:15.383799 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:25:15.506679 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:25:15.621739 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:25:15.735434 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:25:15.948589 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:25:16.268135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21649): Launched 22:25:16.557869 run iperf3-srv_10.42.42.10(pid=21650): Launched 22:25:16.692896 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:25:16.920872 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:25:17.291903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21651): Launched 22:25:17.575373 run iperf3-srv_10.42.42.10(pid=21652): Launched 22:25:17.698366 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:25:17.919032 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:25:18.248450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21653): Launched 22:25:18.532302 run iperf3-srv_10.42.42.10(pid=21654): Launched 22:25:18.654875 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:25:18.875051 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:25:19.203998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21655): Launched 22:25:19.487129 run iperf3-srv_10.42.42.10(pid=21656): Launched 22:25:19.609374 tst iperf3m4.py:8: start network... 22:25:19.829405 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:25:20.337791 run create_hlr_db(pid=21657): Launched 22:25:20.470616 bus /gobi_6: Setting Powered False 22:25:21.535473 run create_hlr_db(pid=21657): Terminated: ok {rc=0} 22:25:21.990209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21659): Launched 22:25:22.317880 run osmo-hlr_10.42.42.2(pid=21660): Launched 22:25:22.442311 run osmo-stp_10.42.42.5: Starting osmo-stp 22:25:23.004799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21662): Launched 22:25:23.332360 run osmo-stp_10.42.42.5(pid=21663): Launched 22:25:23.457621 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:25:24.022365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21665): Launched 22:25:24.147845 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:25:24.424621 run patchelf(pid=21666): Launched 22:25:24.606963 run osmo-stp_10.42.42.5(pid=21663): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21663)] 22:25:24.745586 run osmo-stp_10.42.42.5(pid=21663): stdout: | (launched: 2022-12-08_22:25:23.273085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:24.885629 run osmo-stp_10.42.42.5(pid=21663): stderr: | 20221208222523465 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222523465 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222523465 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222523466 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222523468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222523468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222523468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:25.025682 run osmo-stp_10.42.42.5(pid=21663): stdout: | (launched: 2022-12-08_22:25:23.273085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:25.158882 run osmo-stp_10.42.42.5(pid=21663): stderr: | 20221208222523465 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222523465 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222523465 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222523466 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222523468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222523468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222523468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:25.308081 run patchelf(pid=21666): Terminating (SIGINT) 22:25:25.480063 run patchelf(pid=21666): Terminated: ok {rc=0} 22:25:25.604232 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21663): Process ended prematurely: osmo-stp_10.42.42.5(pid=21663) [trial-2350↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21663)] [trial-2350↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 22:25:25.614008 tst iperf3m4.py:8: Test FAILED (11.1 sec) 22:25:25.642655 run osmo-hlr_10.42.42.2(pid=21660): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21660)] 22:25:25.691362 run osmo-hlr_10.42.42.2(pid=21660): stdout: | (launched: 2022-12-08_22:25:22.258863) 22:25:25.741868 run osmo-hlr_10.42.42.2(pid=21660): stderr: | 20221208222522457 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222522457 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222522457 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222522457 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222522457 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222522457 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222522469 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222522477 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222522478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222522478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:25:25.792628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21649): Terminating (SIGTERM) 22:25:25.833162 run iperf3-srv_10.42.42.10(pid=21650): Terminating (SIGTERM) 22:25:25.874584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21651): Terminating (SIGTERM) 22:25:25.915496 run iperf3-srv_10.42.42.10(pid=21652): Terminating (SIGTERM) 22:25:25.956102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21653): Terminating (SIGTERM) 22:25:25.997011 run iperf3-srv_10.42.42.10(pid=21654): Terminating (SIGTERM) 22:25:26.037997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21655): Terminating (SIGTERM) 22:25:26.078920 run iperf3-srv_10.42.42.10(pid=21656): Terminating (SIGTERM) 22:25:26.119498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21659): Terminating (SIGTERM) 22:25:26.160275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21662): Terminating (SIGTERM) 22:25:26.200912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21665): Terminating (SIGTERM) 22:25:26.242633 --- ParallelTerminationStrategy: PID 21649 died... 22:25:26.262003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21649): Terminated: ok {rc=0} 22:25:26.307616 --- ParallelTerminationStrategy: PID 21650 died... 22:25:26.326502 run iperf3-srv_10.42.42.10(pid=21650): Terminated {rc=256} 22:25:26.371935 --- ParallelTerminationStrategy: PID 21651 died... 22:25:26.390931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21651): Terminated: ok {rc=0} 22:25:26.437231 --- ParallelTerminationStrategy: PID 21652 died... 22:25:26.456023 run iperf3-srv_10.42.42.10(pid=21652): Terminated {rc=256} 22:25:26.501318 --- ParallelTerminationStrategy: PID 21653 died... 22:25:26.520063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21653): Terminated: ok {rc=0} 22:25:26.565782 --- ParallelTerminationStrategy: PID 21654 died... 22:25:26.584641 run iperf3-srv_10.42.42.10(pid=21654): Terminated {rc=256} 22:25:26.629797 --- ParallelTerminationStrategy: PID 21655 died... 22:25:26.648729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21655): Terminated: ok {rc=0} 22:25:26.693977 --- ParallelTerminationStrategy: PID 21656 died... 22:25:26.712823 run iperf3-srv_10.42.42.10(pid=21656): Terminated {rc=256} 22:25:26.757921 --- ParallelTerminationStrategy: PID 21659 died... 22:25:26.776868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21659): Terminated: ok {rc=0} 22:25:26.822223 --- ParallelTerminationStrategy: PID 21662 died... 22:25:26.841234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21662): Terminated: ok {rc=0} 22:25:26.887175 --- ParallelTerminationStrategy: PID 21665 died... 22:25:26.906171 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21665): Terminated: ok {rc=0} 22:25:26.991533 bus /gobi_4: Setting Powered False 22:25:28.090822 bus /gobi_4: Setting Powered False 22:25:29.211539 bus /gobi_1: Setting Powered False 22:25:30.311833 bus /gobi_1: Setting Powered False 22:25:31.430415 bus /gobi_0: Setting Powered False 22:25:32.531896 bus /gobi_0: Setting Powered False 22:25:33.650080 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 22:25:34.754532 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:34.766410 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:25:34.817539 tst ping.py: using LAC 17161 22:25:34.939453 tst ping.py: using RAC 76 22:25:35.058496 tst ping.py: using CellId 17161 22:25:35.178361 tst ping.py: using BVCI 17162 22:25:35.290407 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:35.301469 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:35.312130 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:35.322935 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:35.333704 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:35.344480 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:35.355404 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:35.366267 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:25:35.477404 tst ping.py:19: start network... 22:25:35.677835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:25:36.141637 run create_hlr_db(pid=21668): Launched 22:25:36.257383 bus /gobi_6: Setting Powered False 22:25:37.317938 run create_hlr_db(pid=21668): Terminated: ok {rc=0} 22:25:37.757725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21670): Launched 22:25:38.078076 run osmo-hlr_10.42.42.2(pid=21671): Launched 22:25:38.201614 run osmo-stp_10.42.42.5: Starting osmo-stp 22:25:38.754638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21673): Launched 22:25:39.073931 run osmo-stp_10.42.42.5(pid=21674): Launched 22:25:39.196074 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:25:39.749335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21676): Launched 22:25:39.871471 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:25:40.142760 run patchelf(pid=21677): Launched 22:25:40.322771 run osmo-stp_10.42.42.5(pid=21674): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21674)] 22:25:40.459299 run osmo-stp_10.42.42.5(pid=21674): stdout: | (launched: 2022-12-08_22:25:39.015939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:40.597394 run osmo-stp_10.42.42.5(pid=21674): stderr: | 20221208222539205 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222539205 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222539206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222539206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222539206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222539207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222539207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:40.735149 run osmo-stp_10.42.42.5(pid=21674): stdout: | (launched: 2022-12-08_22:25:39.015939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:40.867299 run osmo-stp_10.42.42.5(pid=21674): stderr: | 20221208222539205 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222539205 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222539206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222539206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222539206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222539207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222539207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:41.023587 run patchelf(pid=21677): Terminating (SIGINT) 22:25:41.204339 run patchelf(pid=21677): Terminated: ok {rc=0} 22:25:41.334095 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21674): Process ended prematurely: osmo-stp_10.42.42.5(pid=21674) [trial-2350↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21674)] [trial-2350↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 22:25:41.343607 tst ping.py:22: Test FAILED (6.6 sec) 22:25:41.372116 run osmo-hlr_10.42.42.2(pid=21671): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21671)] 22:25:41.423098 run osmo-hlr_10.42.42.2(pid=21671): stdout: | (launched: 2022-12-08_22:25:38.019814) 22:25:41.475739 run osmo-hlr_10.42.42.2(pid=21671): stderr: | 20221208222538217 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222538217 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222538217 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222538217 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222538217 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222538217 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222538229 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222538237 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222538238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222538238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:25:41.528876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21670): Terminating (SIGTERM) 22:25:41.571433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21673): Terminating (SIGTERM) 22:25:41.614136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21676): Terminating (SIGTERM) 22:25:41.657210 --- ParallelTerminationStrategy: PID 21670 died... 22:25:41.677599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21670): Terminated: ok {rc=0} 22:25:41.725185 --- ParallelTerminationStrategy: PID 21673 died... 22:25:41.745206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21673): Terminated: ok {rc=0} 22:25:41.792438 --- ParallelTerminationStrategy: PID 21676 died... 22:25:41.812464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21676): Terminated: ok {rc=0} 22:25:41.922779 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:25:43.010414 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:43.022399 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:25:43.074014 tst ping_idle_ping.py: using LAC 17162 22:25:43.200936 tst ping_idle_ping.py: using RAC 77 22:25:43.326145 tst ping_idle_ping.py: using CellId 17162 22:25:43.450977 tst ping_idle_ping.py: using BVCI 17163 22:25:43.566917 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:43.578269 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:43.589400 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:43.600860 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:43.611880 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:43.622890 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:43.634118 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:43.645285 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:25:43.764412 tst ping_idle_ping.py:24: start network... 22:25:43.980848 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:25:44.481259 run create_hlr_db(pid=21678): Launched 22:25:44.611731 bus /gobi_6: Setting Powered False 22:25:45.675990 run create_hlr_db(pid=21678): Terminated: ok {rc=0} 22:25:46.145856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21680): Launched 22:25:46.476176 run osmo-hlr_10.42.42.2(pid=21681): Launched 22:25:46.731936 run osmo-stp_10.42.42.5: Starting osmo-stp 22:25:47.460069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21683): Launched 22:25:47.762907 run osmo-stp_10.42.42.5(pid=21684): Launched 22:25:47.876931 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:25:48.397075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21686): Launched 22:25:48.512661 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:25:48.766806 run patchelf(pid=21687): Launched 22:25:48.934612 run osmo-stp_10.42.42.5(pid=21684): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21684)] 22:25:49.063232 run osmo-stp_10.42.42.5(pid=21684): stdout: | (launched: 2022-12-08_22:25:47.708257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:49.192925 run osmo-stp_10.42.42.5(pid=21684): stderr: | 20221208222547879 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222547879 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222547879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222547880 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222547880 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222547880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222547880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:49.322894 run osmo-stp_10.42.42.5(pid=21684): stdout: | (launched: 2022-12-08_22:25:47.708257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:49.447544 run osmo-stp_10.42.42.5(pid=21684): stderr: | 20221208222547879 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222547879 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222547879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222547880 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222547880 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222547880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222547880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:49.594601 run patchelf(pid=21687): Terminating (SIGINT) 22:25:49.765086 run patchelf(pid=21687): Terminated: ok {rc=0} 22:25:49.887721 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21684): Process ended prematurely: osmo-stp_10.42.42.5(pid=21684) [trial-2350↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21684)] [trial-2350↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 22:25:49.896788 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 22:25:49.924282 run osmo-hlr_10.42.42.2(pid=21681): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21681)] 22:25:49.972889 run osmo-hlr_10.42.42.2(pid=21681): stdout: | (launched: 2022-12-08_22:25:46.413418) 22:25:50.023351 run osmo-hlr_10.42.42.2(pid=21681): stderr: | 20221208222546724 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222546724 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222546725 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222546725 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222546725 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222546725 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222546744 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222546769 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222546769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222546769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:25:50.074492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21680): Terminating (SIGTERM) 22:25:50.115346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21683): Terminating (SIGTERM) 22:25:50.156211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21686): Terminating (SIGTERM) 22:25:50.197290 --- ParallelTerminationStrategy: PID 21680 died... 22:25:50.216780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21680): Terminated: ok {rc=0} 22:25:50.262844 --- ParallelTerminationStrategy: PID 21683 died... 22:25:50.281836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21683): Terminated: ok {rc=0} 22:25:50.327191 --- ParallelTerminationStrategy: PID 21686 died... 22:25:50.346324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21686): Terminated: ok {rc=0} 22:25:50.434381 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:25:51.732444 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:25:51.738808 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:25:51.771856 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:25:51.809888 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:25:51.895005 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:25:51.926951 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:25:51.965069 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:25:52.557990 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:25:52.607543 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:52.618334 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:25:52.686532 tst cs_paging_gprs_active.py: using LAC 17163 22:25:52.808930 tst cs_paging_gprs_active.py: using RAC 78 22:25:52.929735 tst cs_paging_gprs_active.py: using CellId 17163 22:25:53.052727 tst cs_paging_gprs_active.py: using BVCI 17164 22:25:53.174530 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:53.186051 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:53.197359 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:53.209075 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:53.220218 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:53.231471 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:53.242638 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:53.253728 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:53.264910 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:25:53.380470 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:25:53.500275 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:25:53.722383 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:25:54.051229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21691): Launched 22:25:54.336277 run iperf3-srv_10.42.42.10(pid=21692): Launched 22:25:54.459680 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:25:54.681011 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:25:55.009705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21693): Launched 22:25:55.294113 run iperf3-srv_10.42.42.10(pid=21694): Launched 22:25:55.416874 tst cs_paging_gprs_active.py:38: start network... 22:25:55.637403 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:25:56.144070 run create_hlr_db(pid=21695): Launched 22:25:56.277826 bus /gobi_6: Setting Powered False 22:25:57.343993 run create_hlr_db(pid=21695): Terminated: ok {rc=0} 22:25:57.782170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21697): Launched 22:25:58.088624 run osmo-hlr_10.42.42.2(pid=21698): Launched 22:25:58.205632 run osmo-stp_10.42.42.5: Starting osmo-stp 22:25:58.747759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21700): Launched 22:25:59.053662 run osmo-stp_10.42.42.5(pid=21701): Launched 22:25:59.171701 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:25:59.702110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21703): Launched 22:25:59.819094 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:26:00.083951 run patchelf(pid=21704): Launched 22:26:00.254822 run osmo-stp_10.42.42.5(pid=21701): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21701)] 22:26:00.384773 run osmo-stp_10.42.42.5(pid=21701): stdout: | (launched: 2022-12-08_22:25:58.997787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:00.516006 run osmo-stp_10.42.42.5(pid=21701): stderr: | 20221208222559166 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222559166 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222559166 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222559167 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222559167 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222559167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222559167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:00.647501 run osmo-stp_10.42.42.5(pid=21701): stdout: | (launched: 2022-12-08_22:25:58.997787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:00.773701 run osmo-stp_10.42.42.5(pid=21701): stderr: | 20221208222559166 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222559166 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222559166 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222559167 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222559167 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222559167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222559167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:00.940001 run patchelf(pid=21704): Terminating (SIGINT) 22:26:01.125855 run patchelf(pid=21704): Terminated: ok {rc=0} 22:26:01.262008 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21701): Process ended prematurely: osmo-stp_10.42.42.5(pid=21701) [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21701)] [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:26:01.272633 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:26:01.302593 run osmo-hlr_10.42.42.2(pid=21698): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21698)] 22:26:01.355356 run osmo-hlr_10.42.42.2(pid=21698): stdout: | (launched: 2022-12-08_22:25:58.032582) 22:26:01.409135 run osmo-hlr_10.42.42.2(pid=21698): stderr: | 20221208222558209 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222558209 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222558209 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222558209 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222558209 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222558209 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222558221 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222558230 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222558230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222558230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:26:01.464260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21691): Terminating (SIGTERM) 22:26:01.508587 run iperf3-srv_10.42.42.10(pid=21692): Terminating (SIGTERM) 22:26:01.555800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21693): Terminating (SIGTERM) 22:26:01.600408 run iperf3-srv_10.42.42.10(pid=21694): Terminating (SIGTERM) 22:26:01.644866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21697): Terminating (SIGTERM) 22:26:01.690360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21700): Terminating (SIGTERM) 22:26:01.735723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21703): Terminating (SIGTERM) 22:26:01.783136 --- ParallelTerminationStrategy: PID 21691 died... 22:26:01.803937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21691): Terminated: ok {rc=0} 22:26:01.854301 --- ParallelTerminationStrategy: PID 21692 died... 22:26:01.874762 run iperf3-srv_10.42.42.10(pid=21692): Terminated {rc=256} 22:26:01.922740 --- ParallelTerminationStrategy: PID 21693 died... 22:26:01.943045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21693): Terminated: ok {rc=0} 22:26:01.990683 --- ParallelTerminationStrategy: PID 21694 died... 22:26:02.011577 run iperf3-srv_10.42.42.10(pid=21694): Terminated {rc=256} 22:26:02.062328 --- ParallelTerminationStrategy: PID 21697 died... 22:26:02.083534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21697): Terminated: ok {rc=0} 22:26:02.131468 --- ParallelTerminationStrategy: PID 21700 died... 22:26:02.151911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21700): Terminated: ok {rc=0} 22:26:02.199611 --- ParallelTerminationStrategy: PID 21703 died... 22:26:02.219697 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21703): Terminated: ok {rc=0} 22:26:02.308200 bus /gobi_0: Setting Powered False 22:26:03.407425 bus /gobi_0: Setting Powered False 22:26:04.523711 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:26:05.673402 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:05.685213 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:26:05.755447 tst iperf3.py: using LAC 17164 22:26:05.885433 tst iperf3.py: using RAC 79 22:26:06.014505 tst iperf3.py: using CellId 17164 22:26:06.143931 tst iperf3.py: using BVCI 17165 22:26:06.257520 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:06.268339 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:06.279275 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:06.290282 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:06.301200 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:06.312051 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:06.323064 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:06.333794 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:06.344629 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:26:06.461435 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:26:06.682357 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:26:07.009047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21705): Launched 22:26:07.292363 run iperf3-srv_10.42.42.10(pid=21706): Launched 22:26:07.414906 tst iperf3.py:8: start network... 22:26:07.634989 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:26:08.140795 run create_hlr_db(pid=21707): Launched 22:26:08.273748 bus /gobi_6: Setting Powered False 22:26:09.338497 run create_hlr_db(pid=21707): Terminated: ok {rc=0} 22:26:09.790320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21709): Launched 22:26:10.114929 run osmo-hlr_10.42.42.2(pid=21710): Launched 22:26:10.238696 run osmo-stp_10.42.42.5: Starting osmo-stp 22:26:10.887264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21712): Launched 22:26:11.204743 run osmo-stp_10.42.42.5(pid=21713): Launched 22:26:11.326397 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:26:11.874902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21715): Launched 22:26:11.996482 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:26:12.266370 run patchelf(pid=21716): Launched 22:26:12.443892 run osmo-stp_10.42.42.5(pid=21713): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21713)] 22:26:12.579398 run osmo-stp_10.42.42.5(pid=21713): stdout: | (launched: 2022-12-08_22:26:11.146910) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:12.715883 run osmo-stp_10.42.42.5(pid=21713): stderr: | 20221208222611340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222611340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222611340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222611341 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222611341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222611341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222611341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:12.852264 run osmo-stp_10.42.42.5(pid=21713): stdout: | (launched: 2022-12-08_22:26:11.146910) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:12.983645 run osmo-stp_10.42.42.5(pid=21713): stderr: | 20221208222611340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222611340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222611340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222611341 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222611341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222611341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222611341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:13.139465 run patchelf(pid=21716): Terminating (SIGINT) 22:26:13.320373 run patchelf(pid=21716): Terminated: ok {rc=0} 22:26:13.449393 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21713): Process ended prematurely: osmo-stp_10.42.42.5(pid=21713) [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21713)] [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 22:26:13.459469 tst iperf3.py:8: Test FAILED (7.8 sec) 22:26:13.488222 run osmo-hlr_10.42.42.2(pid=21710): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21710)] 22:26:13.538604 run osmo-hlr_10.42.42.2(pid=21710): stdout: | (launched: 2022-12-08_22:26:10.055857) 22:26:13.590763 run osmo-hlr_10.42.42.2(pid=21710): stderr: | 20221208222610255 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222610255 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222610255 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222610255 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222610255 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222610255 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222610267 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222610276 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222610276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222610276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:26:13.643182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21705): Terminating (SIGTERM) 22:26:13.685149 run iperf3-srv_10.42.42.10(pid=21706): Terminating (SIGTERM) 22:26:13.727380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21709): Terminating (SIGTERM) 22:26:13.769966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21712): Terminating (SIGTERM) 22:26:13.812397 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21715): Terminating (SIGTERM) 22:26:13.854973 --- ParallelTerminationStrategy: PID 21705 died... 22:26:13.875262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21705): Terminated: ok {rc=0} 22:26:13.922170 --- ParallelTerminationStrategy: PID 21706 died... 22:26:13.941846 run iperf3-srv_10.42.42.10(pid=21706): Terminated {rc=256} 22:26:13.988439 --- ParallelTerminationStrategy: PID 21709 died... 22:26:14.008174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21709): Terminated: ok {rc=0} 22:26:14.054709 --- ParallelTerminationStrategy: PID 21712 died... 22:26:14.074344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21712): Terminated: ok {rc=0} 22:26:14.120855 --- ParallelTerminationStrategy: PID 21715 died... 22:26:14.140865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21715): Terminated: ok {rc=0} 22:26:14.229794 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:26:15.374956 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:15.386445 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:26:15.453400 tst iperf3m4.py: using LAC 17165 22:26:15.570650 tst iperf3m4.py: using RAC 80 22:26:15.695355 tst iperf3m4.py: using CellId 17165 22:26:15.821710 tst iperf3m4.py: using BVCI 17166 22:26:15.950151 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:15.961890 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:15.973493 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:15.985178 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:15.996492 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:16.007975 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:16.019601 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:16.030995 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:16.042711 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:26:16.160421 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:26:16.300612 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:26:16.437550 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:26:16.567134 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:26:16.785789 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:26:17.115327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21717): Launched 22:26:17.399533 run iperf3-srv_10.42.42.10(pid=21718): Launched 22:26:17.519196 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:26:17.733842 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:26:18.054007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21719): Launched 22:26:18.331493 run iperf3-srv_10.42.42.10(pid=21720): Launched 22:26:18.451262 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:26:18.666003 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:26:18.985971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21721): Launched 22:26:19.263425 run iperf3-srv_10.42.42.10(pid=21722): Launched 22:26:19.383090 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:26:19.597462 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:26:19.917376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21723): Launched 22:26:20.195296 run iperf3-srv_10.42.42.10(pid=21724): Launched 22:26:20.315106 tst iperf3m4.py:8: start network... 22:26:20.529977 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:26:21.027335 run create_hlr_db(pid=21725): Launched 22:26:21.158039 bus /gobi_6: Setting Powered False 22:26:22.222281 run create_hlr_db(pid=21725): Terminated: ok {rc=0} 22:26:22.652504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21727): Launched 22:26:22.952288 run osmo-hlr_10.42.42.2(pid=21728): Launched 22:26:23.066645 run osmo-stp_10.42.42.5: Starting osmo-stp 22:26:23.586426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21730): Launched 22:26:23.885400 run osmo-stp_10.42.42.5(pid=21731): Launched 22:26:23.999138 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:26:24.518004 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21733): Launched 22:26:24.632258 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:26:24.886131 run patchelf(pid=21734): Launched 22:26:25.052569 run osmo-stp_10.42.42.5(pid=21731): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21731)] 22:26:25.180545 run osmo-stp_10.42.42.5(pid=21731): stdout: | (launched: 2022-12-08_22:26:23.830763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:25.309605 run osmo-stp_10.42.42.5(pid=21731): stderr: | 20221208222623999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222623999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222623999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222624000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222624000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222624000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222624000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:25.438736 run osmo-stp_10.42.42.5(pid=21731): stdout: | (launched: 2022-12-08_22:26:23.830763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:25.562749 run osmo-stp_10.42.42.5(pid=21731): stderr: | 20221208222623999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222623999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222623999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222624000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222624000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222624000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222624000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:25.709523 run patchelf(pid=21734): Terminating (SIGINT) 22:26:25.878711 run patchelf(pid=21734): Terminated: ok {rc=0} 22:26:26.000449 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21731): Process ended prematurely: osmo-stp_10.42.42.5(pid=21731) [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21731)] [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:26:26.010124 tst iperf3m4.py:8: Test FAILED (10.7 sec) 22:26:26.038443 run osmo-hlr_10.42.42.2(pid=21728): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21728)] 22:26:26.087397 run osmo-hlr_10.42.42.2(pid=21728): stdout: | (launched: 2022-12-08_22:26:22.897559) 22:26:26.138101 run osmo-hlr_10.42.42.2(pid=21728): stderr: | 20221208222623075 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222623075 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222623075 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222623075 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222623075 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222623075 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222623087 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222623097 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222623097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222623097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:26:26.189368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21717): Terminating (SIGTERM) 22:26:26.230158 run iperf3-srv_10.42.42.10(pid=21718): Terminating (SIGTERM) 22:26:26.271250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21719): Terminating (SIGTERM) 22:26:26.312221 run iperf3-srv_10.42.42.10(pid=21720): Terminating (SIGTERM) 22:26:26.353020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21721): Terminating (SIGTERM) 22:26:26.394600 run iperf3-srv_10.42.42.10(pid=21722): Terminating (SIGTERM) 22:26:26.435438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21723): Terminating (SIGTERM) 22:26:26.476326 run iperf3-srv_10.42.42.10(pid=21724): Terminating (SIGTERM) 22:26:26.518639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21727): Terminating (SIGTERM) 22:26:26.560215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21730): Terminating (SIGTERM) 22:26:26.601263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21733): Terminating (SIGTERM) 22:26:26.642092 --- ParallelTerminationStrategy: PID 21717 died... 22:26:26.661502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21717): Terminated: ok {rc=0} 22:26:26.706974 --- ParallelTerminationStrategy: PID 21718 died... 22:26:26.725752 run iperf3-srv_10.42.42.10(pid=21718): Terminated {rc=256} 22:26:26.770688 --- ParallelTerminationStrategy: PID 21719 died... 22:26:26.789408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21719): Terminated: ok {rc=0} 22:26:26.834531 --- ParallelTerminationStrategy: PID 21720 died... 22:26:26.853395 run iperf3-srv_10.42.42.10(pid=21720): Terminated {rc=256} 22:26:26.898436 --- ParallelTerminationStrategy: PID 21721 died... 22:26:26.917381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21721): Terminated: ok {rc=0} 22:26:26.962630 --- ParallelTerminationStrategy: PID 21722 died... 22:26:26.981313 run iperf3-srv_10.42.42.10(pid=21722): Terminated {rc=256} 22:26:27.026459 --- ParallelTerminationStrategy: PID 21723 died... 22:26:27.045461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21723): Terminated: ok {rc=0} 22:26:27.090738 --- ParallelTerminationStrategy: PID 21724 died... 22:26:27.109680 run iperf3-srv_10.42.42.10(pid=21724): Terminated {rc=256} 22:26:27.154887 --- ParallelTerminationStrategy: PID 21727 died... 22:26:27.173924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21727): Terminated: ok {rc=0} 22:26:27.219283 --- ParallelTerminationStrategy: PID 21730 died... 22:26:27.238206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21730): Terminated: ok {rc=0} 22:26:27.283575 --- ParallelTerminationStrategy: PID 21733 died... 22:26:27.302381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21733): Terminated: ok {rc=0} 22:26:27.387961 bus /gobi_4: Setting Powered False 22:26:28.488574 bus /gobi_4: Setting Powered False 22:26:29.607883 bus /gobi_1: Setting Powered False 22:26:30.710029 bus /gobi_1: Setting Powered False 22:26:31.842014 bus /gobi_0: Setting Powered False 22:26:32.943412 bus /gobi_0: Setting Powered False 22:26:34.062757 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:26:35.166693 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:35.178807 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:26:35.250163 tst ping.py: using LAC 17166 22:26:35.369259 tst ping.py: using RAC 81 22:26:35.486895 tst ping.py: using CellId 17166 22:26:35.606839 tst ping.py: using BVCI 17167 22:26:35.716310 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:35.727355 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:35.738396 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:35.749366 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:35.760062 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:35.770932 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:35.781835 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:35.792634 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:26:35.909358 tst ping.py:19: start network... 22:26:36.120347 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:26:36.610413 run create_hlr_db(pid=21735): Launched 22:26:36.738406 bus /gobi_6: Setting Powered False 22:26:37.801188 run create_hlr_db(pid=21735): Terminated: ok {rc=0} 22:26:38.240898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21737): Launched 22:26:38.554538 run osmo-hlr_10.42.42.2(pid=21738): Launched 22:26:38.673808 run osmo-stp_10.42.42.5: Starting osmo-stp 22:26:39.221280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21740): Launched 22:26:39.535494 run osmo-stp_10.42.42.5(pid=21741): Launched 22:26:39.655481 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:26:40.186627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21743): Launched 22:26:40.301134 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:26:40.550966 run patchelf(pid=21744): Launched 22:26:40.716549 run osmo-stp_10.42.42.5(pid=21741): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21741)] 22:26:40.843334 run osmo-stp_10.42.42.5(pid=21741): stdout: | (launched: 2022-12-08_22:26:39.478655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:40.970901 run osmo-stp_10.42.42.5(pid=21741): stderr: | 20221208222639669 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222639670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222639670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222639670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222639671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222639671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222639671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:41.099382 run osmo-stp_10.42.42.5(pid=21741): stdout: | (launched: 2022-12-08_22:26:39.478655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:41.221600 run osmo-stp_10.42.42.5(pid=21741): stderr: | 20221208222639669 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222639670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222639670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222639670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222639671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222639671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222639671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:41.366757 run patchelf(pid=21744): Terminating (SIGINT) 22:26:41.533843 run patchelf(pid=21744): Terminated: ok {rc=0} 22:26:41.654388 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21741): Process ended prematurely: osmo-stp_10.42.42.5(pid=21741) [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21741)] [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 22:26:41.663411 tst ping.py:22: Test FAILED (6.5 sec) 22:26:41.690841 run osmo-hlr_10.42.42.2(pid=21738): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21738)] 22:26:41.739966 run osmo-hlr_10.42.42.2(pid=21738): stdout: | (launched: 2022-12-08_22:26:38.497790) 22:26:41.790677 run osmo-hlr_10.42.42.2(pid=21738): stderr: | 20221208222638696 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222638696 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222638696 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222638696 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222638697 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222638697 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222638710 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222638718 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222638718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222638718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:26:41.842135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21737): Terminating (SIGTERM) 22:26:41.882841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21740): Terminating (SIGTERM) 22:26:41.923619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21743): Terminating (SIGTERM) 22:26:41.964713 --- ParallelTerminationStrategy: PID 21737 died... 22:26:41.984137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21737): Terminated: ok {rc=0} 22:26:42.029690 --- ParallelTerminationStrategy: PID 21740 died... 22:26:42.048541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21740): Terminated: ok {rc=0} 22:26:42.093912 --- ParallelTerminationStrategy: PID 21743 died... 22:26:42.112935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21743): Terminated: ok {rc=0} 22:26:42.200706 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:26:43.290964 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:43.302891 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:26:43.375350 tst ping_idle_ping.py: using LAC 17167 22:26:43.493370 tst ping_idle_ping.py: using RAC 82 22:26:43.609375 tst ping_idle_ping.py: using CellId 17167 22:26:43.725027 tst ping_idle_ping.py: using BVCI 17168 22:26:43.832713 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:43.843514 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:43.854107 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:43.864877 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:43.875896 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:43.886738 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:43.897575 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:43.908312 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:26:44.023346 tst ping_idle_ping.py:24: start network... 22:26:44.237546 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:26:44.726361 run create_hlr_db(pid=21745): Launched 22:26:44.855065 bus /gobi_6: Setting Powered False 22:26:45.926340 run create_hlr_db(pid=21745): Terminated: ok {rc=0} 22:26:46.385993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21747): Launched 22:26:46.712652 run osmo-hlr_10.42.42.2(pid=21748): Launched 22:26:46.942454 run osmo-stp_10.42.42.5: Starting osmo-stp 22:26:47.503521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21750): Launched 22:26:47.801904 run osmo-stp_10.42.42.5(pid=21751): Launched 22:26:47.913710 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:26:48.424745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21753): Launched 22:26:48.538355 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:26:48.789659 run patchelf(pid=21754): Launched 22:26:48.955415 run osmo-stp_10.42.42.5(pid=21751): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21751)] 22:26:49.082416 run osmo-stp_10.42.42.5(pid=21751): stdout: | (launched: 2022-12-08_22:26:47.747943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:49.211130 run osmo-stp_10.42.42.5(pid=21751): stderr: | 20221208222647918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222647918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222647918 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222647919 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222647919 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222647919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222647919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:49.339374 run osmo-stp_10.42.42.5(pid=21751): stdout: | (launched: 2022-12-08_22:26:47.747943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:49.462409 run osmo-stp_10.42.42.5(pid=21751): stderr: | 20221208222647918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222647918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222647918 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222647919 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222647919 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222647919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222647919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:49.607235 run patchelf(pid=21754): Terminating (SIGINT) 22:26:49.775685 run patchelf(pid=21754): Terminated: ok {rc=0} 22:26:49.896572 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21751): Process ended prematurely: osmo-stp_10.42.42.5(pid=21751) [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21751)] [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:26:49.905889 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:26:49.933168 run osmo-hlr_10.42.42.2(pid=21748): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21748)] 22:26:49.981855 run osmo-hlr_10.42.42.2(pid=21748): stdout: | (launched: 2022-12-08_22:26:46.650456) 22:26:50.032152 run osmo-hlr_10.42.42.2(pid=21748): stderr: | 20221208222646857 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222646857 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222646857 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222646857 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222646857 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222646857 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222646874 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222646898 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222646898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222646898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:26:50.082603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21747): Terminating (SIGTERM) 22:26:50.123095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21750): Terminating (SIGTERM) 22:26:50.163249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21753): Terminating (SIGTERM) 22:26:50.205239 --- ParallelTerminationStrategy: PID 21747 died... 22:26:50.224251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21747): Terminated: ok {rc=0} 22:26:50.269554 --- ParallelTerminationStrategy: PID 21750 died... 22:26:50.288196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21750): Terminated: ok {rc=0} 22:26:50.333354 --- ParallelTerminationStrategy: PID 21753 died... 22:26:50.352096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21753): Terminated: ok {rc=0} 22:26:50.437316 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:26:51.746300 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:26:51.753456 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:26:51.787677 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 22:26:51.827445 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 22:26:51.915686 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:26:51.949199 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 22:26:51.988677 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 22:26:52.584445 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 22:26:52.636625 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:52.647890 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:26:52.720494 tst cs_paging_gprs_active.py: using LAC 17168 22:26:52.850123 tst cs_paging_gprs_active.py: using RAC 83 22:26:52.976922 tst cs_paging_gprs_active.py: using CellId 17168 22:26:53.095989 tst cs_paging_gprs_active.py: using BVCI 17169 22:26:53.207065 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:53.218034 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:53.228782 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:53.239922 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:53.251328 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:53.262404 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:53.273538 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:53.284550 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:53.295725 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:26:53.415427 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:26:53.539112 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:26:53.755563 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:26:54.077961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21759): Launched 22:26:54.358722 run iperf3-srv_10.42.42.10(pid=21760): Launched 22:26:54.479662 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:26:54.695809 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:26:55.019702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21761): Launched 22:26:55.300393 run iperf3-srv_10.42.42.10(pid=21762): Launched 22:26:55.421265 tst cs_paging_gprs_active.py:38: start network... 22:26:55.638012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:26:56.137128 run create_hlr_db(pid=21763): Launched 22:26:56.269481 bus /gobi_6: Setting Powered False 22:26:57.333786 run create_hlr_db(pid=21763): Terminated: ok {rc=0} 22:26:57.763703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21765): Launched 22:26:58.064740 run osmo-hlr_10.42.42.2(pid=21766): Launched 22:26:58.179314 run osmo-stp_10.42.42.5: Starting osmo-stp 22:26:58.712485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21768): Launched 22:26:59.014067 run osmo-stp_10.42.42.5(pid=21769): Launched 22:26:59.128714 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:26:59.648352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21771): Launched 22:26:59.763749 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:27:00.019611 run patchelf(pid=21772): Launched 22:27:00.187349 run osmo-stp_10.42.42.5(pid=21769): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21769)] 22:27:00.315309 run osmo-stp_10.42.42.5(pid=21769): stdout: | (launched: 2022-12-08_22:26:58.959143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:00.445050 run osmo-stp_10.42.42.5(pid=21769): stderr: | 20221208222659130 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222659130 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222659130 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222659131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222659131 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222659131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222659131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:00.574672 run osmo-stp_10.42.42.5(pid=21769): stdout: | (launched: 2022-12-08_22:26:58.959143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:00.699356 run osmo-stp_10.42.42.5(pid=21769): stderr: | 20221208222659130 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222659130 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222659130 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222659131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222659131 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222659131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222659131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:00.848225 run patchelf(pid=21772): Terminating (SIGINT) 22:27:01.021807 run patchelf(pid=21772): Terminated: ok {rc=0} 22:27:01.147410 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21769): Process ended prematurely: osmo-stp_10.42.42.5(pid=21769) [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21769)] [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 22:27:01.158240 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 22:27:01.188335 run osmo-hlr_10.42.42.2(pid=21766): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21766)] 22:27:01.239529 run osmo-hlr_10.42.42.2(pid=21766): stdout: | (launched: 2022-12-08_22:26:58.010068) 22:27:01.292467 run osmo-hlr_10.42.42.2(pid=21766): stderr: | 20221208222658186 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222658186 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222658186 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222658187 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222658187 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222658187 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222658199 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222658209 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222658210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222658210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:27:01.346143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21759): Terminating (SIGTERM) 22:27:01.389506 run iperf3-srv_10.42.42.10(pid=21760): Terminating (SIGTERM) 22:27:01.435556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21761): Terminating (SIGTERM) 22:27:01.479362 run iperf3-srv_10.42.42.10(pid=21762): Terminating (SIGTERM) 22:27:01.525492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21765): Terminating (SIGTERM) 22:27:01.569560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21768): Terminating (SIGTERM) 22:27:01.614464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21771): Terminating (SIGTERM) 22:27:01.657592 --- ParallelTerminationStrategy: PID 21759 died... 22:27:01.677492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21759): Terminated: ok {rc=0} 22:27:01.725660 --- ParallelTerminationStrategy: PID 21760 died... 22:27:01.745462 run iperf3-srv_10.42.42.10(pid=21760): Terminated {rc=256} 22:27:01.793616 --- ParallelTerminationStrategy: PID 21761 died... 22:27:01.813456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21761): Terminated: ok {rc=0} 22:27:01.862165 --- ParallelTerminationStrategy: PID 21762 died... 22:27:01.882168 run iperf3-srv_10.42.42.10(pid=21762): Terminated {rc=256} 22:27:01.930444 --- ParallelTerminationStrategy: PID 21765 died... 22:27:01.950248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21765): Terminated: ok {rc=0} 22:27:01.998364 --- ParallelTerminationStrategy: PID 21768 died... 22:27:02.018154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21768): Terminated: ok {rc=0} 22:27:02.066104 --- ParallelTerminationStrategy: PID 21771 died... 22:27:02.085959 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21771): Terminated: ok {rc=0} 22:27:02.174540 bus /gobi_0: Setting Powered False 22:27:03.273264 bus /gobi_0: Setting Powered False 22:27:04.390281 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 22:27:05.536784 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:05.548370 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:27:05.618362 tst iperf3.py: using LAC 17169 22:27:05.738340 tst iperf3.py: using RAC 84 22:27:05.859156 tst iperf3.py: using CellId 17169 22:27:05.979584 tst iperf3.py: using BVCI 17170 22:27:06.097884 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:06.109715 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:06.121086 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:06.132349 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:06.143578 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:06.154967 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:06.166402 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:06.177586 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:06.189320 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:27:06.303122 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:27:06.505269 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:27:06.806740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21773): Launched 22:27:07.069015 run iperf3-srv_10.42.42.10(pid=21774): Launched 22:27:07.182586 tst iperf3.py:8: start network... 22:27:07.383675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:27:07.849568 run create_hlr_db(pid=21775): Launched 22:27:07.981371 bus /gobi_6: Setting Powered False 22:27:09.045159 run create_hlr_db(pid=21775): Terminated: ok {rc=0} 22:27:09.473690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21777): Launched 22:27:09.775866 run osmo-hlr_10.42.42.2(pid=21778): Launched 22:27:09.889642 run osmo-stp_10.42.42.5: Starting osmo-stp 22:27:10.423827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21780): Launched 22:27:10.723723 run osmo-stp_10.42.42.5(pid=21781): Launched 22:27:10.838463 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:27:11.358206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21783): Launched 22:27:11.473872 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:27:11.728557 run patchelf(pid=21784): Launched 22:27:11.896536 run osmo-stp_10.42.42.5(pid=21781): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21781)] 22:27:12.024507 run osmo-stp_10.42.42.5(pid=21781): stdout: | (launched: 2022-12-08_22:27:10.668867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:12.153848 run osmo-stp_10.42.42.5(pid=21781): stderr: | 20221208222710839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222710839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222710839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222710840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222710840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222710840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222710840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:12.283542 run osmo-stp_10.42.42.5(pid=21781): stdout: | (launched: 2022-12-08_22:27:10.668867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:12.407563 run osmo-stp_10.42.42.5(pid=21781): stderr: | 20221208222710839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222710839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222710839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222710840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222710840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222710840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222710840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:12.554886 run patchelf(pid=21784): Terminating (SIGINT) 22:27:12.725506 run patchelf(pid=21784): Terminated: ok {rc=0} 22:27:12.848444 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21781): Process ended prematurely: osmo-stp_10.42.42.5(pid=21781) [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21781)] [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 22:27:12.858264 tst iperf3.py:8: Test FAILED (7.4 sec) 22:27:12.886329 run osmo-hlr_10.42.42.2(pid=21778): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21778)] 22:27:12.935005 run osmo-hlr_10.42.42.2(pid=21778): stdout: | (launched: 2022-12-08_22:27:09.720874) 22:27:12.985854 run osmo-hlr_10.42.42.2(pid=21778): stderr: | 20221208222709898 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222709898 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222709899 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222709899 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222709899 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222709899 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222709910 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222709919 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222709919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222709919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:27:13.036570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21773): Terminating (SIGTERM) 22:27:13.077392 run iperf3-srv_10.42.42.10(pid=21774): Terminating (SIGTERM) 22:27:13.118399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21777): Terminating (SIGTERM) 22:27:13.159342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21780): Terminating (SIGTERM) 22:27:13.200418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21783): Terminating (SIGTERM) 22:27:13.241442 --- ParallelTerminationStrategy: PID 21773 died... 22:27:13.260706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21773): Terminated: ok {rc=0} 22:27:13.306528 --- ParallelTerminationStrategy: PID 21774 died... 22:27:13.325424 run iperf3-srv_10.42.42.10(pid=21774): Terminated {rc=256} 22:27:13.370753 --- ParallelTerminationStrategy: PID 21777 died... 22:27:13.389768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21777): Terminated: ok {rc=0} 22:27:13.435056 --- ParallelTerminationStrategy: PID 21780 died... 22:27:13.454100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21780): Terminated: ok {rc=0} 22:27:13.499518 --- ParallelTerminationStrategy: PID 21783 died... 22:27:13.518506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21783): Terminated: ok {rc=0} 22:27:13.605900 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 22:27:14.754323 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:14.765863 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:27:14.834715 tst iperf3m4.py: using LAC 17170 22:27:14.956809 tst iperf3m4.py: using RAC 85 22:27:15.078052 tst iperf3m4.py: using CellId 17170 22:27:15.201426 tst iperf3m4.py: using BVCI 17171 22:27:15.312641 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:15.323505 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:15.334158 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:15.345243 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:15.355914 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:15.366655 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:15.377919 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:15.388707 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:15.400436 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:27:15.516104 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:27:15.636237 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:27:15.751637 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:27:15.870308 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:27:16.119872 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:27:16.437114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21785): Launched 22:27:16.713859 run iperf3-srv_10.42.42.10(pid=21786): Launched 22:27:16.833772 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:27:17.042828 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:27:17.354176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21787): Launched 22:27:17.615671 run iperf3-srv_10.42.42.10(pid=21788): Launched 22:27:17.728577 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:27:17.930452 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:27:18.232858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21789): Launched 22:27:18.494947 run iperf3-srv_10.42.42.10(pid=21790): Launched 22:27:18.608357 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:27:18.809813 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:27:19.112628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21791): Launched 22:27:19.375214 run iperf3-srv_10.42.42.10(pid=21792): Launched 22:27:19.488443 tst iperf3m4.py:8: start network... 22:27:19.689693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:27:20.156126 run create_hlr_db(pid=21793): Launched 22:27:20.270880 bus /gobi_6: Setting Powered False 22:27:21.331340 run create_hlr_db(pid=21793): Terminated: ok {rc=0} 22:27:21.750043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21795): Launched 22:27:22.050936 run osmo-hlr_10.42.42.2(pid=21796): Launched 22:27:22.166166 run osmo-stp_10.42.42.5: Starting osmo-stp 22:27:22.687017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21798): Launched 22:27:22.986944 run osmo-stp_10.42.42.5(pid=21799): Launched 22:27:23.102318 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:27:23.622932 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21801): Launched 22:27:23.738391 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:27:23.993148 run patchelf(pid=21802): Launched 22:27:24.161837 run osmo-stp_10.42.42.5(pid=21799): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21799)] 22:27:24.289749 run osmo-stp_10.42.42.5(pid=21799): stdout: | (launched: 2022-12-08_22:27:22.931959) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:24.419272 run osmo-stp_10.42.42.5(pid=21799): stderr: | 20221208222723101 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222723101 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222723102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222723102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222723102 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222723102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222723103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:24.548801 run osmo-stp_10.42.42.5(pid=21799): stdout: | (launched: 2022-12-08_22:27:22.931959) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:24.672806 run osmo-stp_10.42.42.5(pid=21799): stderr: | 20221208222723101 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222723101 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222723102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222723102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222723102 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222723102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222723103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:24.819954 run patchelf(pid=21802): Terminating (SIGINT) 22:27:24.991138 run patchelf(pid=21802): Terminated: ok {rc=0} 22:27:25.113914 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21799): Process ended prematurely: osmo-stp_10.42.42.5(pid=21799) [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21799)] [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 22:27:25.123601 tst iperf3m4.py:8: Test FAILED (10.4 sec) 22:27:25.151936 run osmo-hlr_10.42.42.2(pid=21796): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21796)] 22:27:25.201123 run osmo-hlr_10.42.42.2(pid=21796): stdout: | (launched: 2022-12-08_22:27:21.995295) 22:27:25.252138 run osmo-hlr_10.42.42.2(pid=21796): stderr: | 20221208222722170 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222722170 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222722170 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222722170 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222722170 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222722170 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222722181 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222722190 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222722190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222722190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:27:25.303739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21785): Terminating (SIGTERM) 22:27:25.344761 run iperf3-srv_10.42.42.10(pid=21786): Terminating (SIGTERM) 22:27:25.385729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21787): Terminating (SIGTERM) 22:27:25.427005 run iperf3-srv_10.42.42.10(pid=21788): Terminating (SIGTERM) 22:27:25.467832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21789): Terminating (SIGTERM) 22:27:25.508579 run iperf3-srv_10.42.42.10(pid=21790): Terminating (SIGTERM) 22:27:25.549253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21791): Terminating (SIGTERM) 22:27:25.589715 run iperf3-srv_10.42.42.10(pid=21792): Terminating (SIGTERM) 22:27:25.630568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21795): Terminating (SIGTERM) 22:27:25.671327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21798): Terminating (SIGTERM) 22:27:25.711900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21801): Terminating (SIGTERM) 22:27:25.752657 --- ParallelTerminationStrategy: PID 21785 died... 22:27:25.772123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21785): Terminated: ok {rc=0} 22:27:25.817584 --- ParallelTerminationStrategy: PID 21786 died... 22:27:25.836240 run iperf3-srv_10.42.42.10(pid=21786): Terminated {rc=256} 22:27:25.881386 --- ParallelTerminationStrategy: PID 21787 died... 22:27:25.900235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21787): Terminated: ok {rc=0} 22:27:25.945118 --- ParallelTerminationStrategy: PID 21788 died... 22:27:25.963845 run iperf3-srv_10.42.42.10(pid=21788): Terminated {rc=256} 22:27:26.009206 --- ParallelTerminationStrategy: PID 21789 died... 22:27:26.028012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21789): Terminated: ok {rc=0} 22:27:26.073353 --- ParallelTerminationStrategy: PID 21790 died... 22:27:26.092176 run iperf3-srv_10.42.42.10(pid=21790): Terminated {rc=256} 22:27:26.137302 --- ParallelTerminationStrategy: PID 21791 died... 22:27:26.156109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21791): Terminated: ok {rc=0} 22:27:26.201453 --- ParallelTerminationStrategy: PID 21792 died... 22:27:26.220220 run iperf3-srv_10.42.42.10(pid=21792): Terminated {rc=256} 22:27:26.265557 --- ParallelTerminationStrategy: PID 21795 died... 22:27:26.284506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21795): Terminated: ok {rc=0} 22:27:26.329457 --- ParallelTerminationStrategy: PID 21798 died... 22:27:26.348278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21798): Terminated: ok {rc=0} 22:27:26.393327 --- ParallelTerminationStrategy: PID 21801 died... 22:27:26.412225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21801): Terminated: ok {rc=0} 22:27:26.497501 bus /gobi_4: Setting Powered False 22:27:27.597776 bus /gobi_4: Setting Powered False 22:27:28.716170 bus /gobi_1: Setting Powered False 22:27:29.815570 bus /gobi_1: Setting Powered False 22:27:30.940493 bus /gobi_0: Setting Powered False 22:27:32.038797 bus /gobi_0: Setting Powered False 22:27:33.156693 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 22:27:34.260521 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:34.272446 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:27:34.344077 tst ping.py: using LAC 17171 22:27:34.468781 tst ping.py: using RAC 86 22:27:34.591740 tst ping.py: using CellId 17171 22:27:34.714091 tst ping.py: using BVCI 17172 22:27:34.828028 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:34.839367 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:34.850604 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:34.861851 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:34.872931 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:34.884110 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:34.895392 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:34.906608 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:27:35.024519 tst ping.py:19: start network... 22:27:35.236681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:27:35.727286 run create_hlr_db(pid=21803): Launched 22:27:35.846751 bus /gobi_6: Setting Powered False 22:27:36.905928 run create_hlr_db(pid=21803): Terminated: ok {rc=0} 22:27:37.320276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21805): Launched 22:27:37.615219 run osmo-hlr_10.42.42.2(pid=21806): Launched 22:27:37.728153 run osmo-stp_10.42.42.5: Starting osmo-stp 22:27:38.249129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21808): Launched 22:27:38.543259 run osmo-stp_10.42.42.5(pid=21809): Launched 22:27:38.655764 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:27:39.165067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21811): Launched 22:27:39.278322 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:27:39.527886 run patchelf(pid=21812): Launched 22:27:39.692335 run osmo-stp_10.42.42.5(pid=21809): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21809)] 22:27:39.818791 run osmo-stp_10.42.42.5(pid=21809): stdout: | (launched: 2022-12-08_22:27:38.489629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:39.946061 run osmo-stp_10.42.42.5(pid=21809): stderr: | 20221208222738656 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222738657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222738657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222738657 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222738658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222738658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222738658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:40.073797 run osmo-stp_10.42.42.5(pid=21809): stdout: | (launched: 2022-12-08_22:27:38.489629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:40.195632 run osmo-stp_10.42.42.5(pid=21809): stderr: | 20221208222738656 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222738657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222738657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222738657 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222738658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222738658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222738658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:40.339903 run patchelf(pid=21812): Terminating (SIGINT) 22:27:40.507418 run patchelf(pid=21812): Terminated: ok {rc=0} 22:27:40.627844 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21809): Process ended prematurely: osmo-stp_10.42.42.5(pid=21809) [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21809)] [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 22:27:40.636849 tst ping.py:22: Test FAILED (6.4 sec) 22:27:40.664326 run osmo-hlr_10.42.42.2(pid=21806): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21806)] 22:27:40.713327 run osmo-hlr_10.42.42.2(pid=21806): stdout: | (launched: 2022-12-08_22:27:37.561652) 22:27:40.763779 run osmo-hlr_10.42.42.2(pid=21806): stderr: | 20221208222737737 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222737737 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222737737 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222737737 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222737737 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222737737 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222737749 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222737758 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222737759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222737759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:27:40.814863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21805): Terminating (SIGTERM) 22:27:40.855579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21808): Terminating (SIGTERM) 22:27:40.896287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21811): Terminating (SIGTERM) 22:27:40.937377 --- ParallelTerminationStrategy: PID 21805 died... 22:27:40.956691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21805): Terminated: ok {rc=0} 22:27:41.002239 --- ParallelTerminationStrategy: PID 21808 died... 22:27:41.021210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21808): Terminated: ok {rc=0} 22:27:41.066656 --- ParallelTerminationStrategy: PID 21811 died... 22:27:41.085607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21811): Terminated: ok {rc=0} 22:27:41.171076 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 22:27:42.259079 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:42.271602 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:27:42.347137 tst ping_idle_ping.py: using LAC 17172 22:27:42.472282 tst ping_idle_ping.py: using RAC 87 22:27:42.596730 tst ping_idle_ping.py: using CellId 17172 22:27:42.722604 tst ping_idle_ping.py: using BVCI 17173 22:27:42.839480 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:42.850940 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:42.862284 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:42.873565 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:42.884618 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:42.895842 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:42.907163 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:42.918433 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:27:43.037358 tst ping_idle_ping.py:24: start network... 22:27:43.250569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:27:43.739201 run create_hlr_db(pid=21813): Launched 22:27:43.866741 bus /gobi_6: Setting Powered False 22:27:44.930039 run create_hlr_db(pid=21813): Terminated: ok {rc=0} 22:27:45.373083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21815): Launched 22:27:45.688189 run osmo-hlr_10.42.42.2(pid=21816): Launched 22:27:45.808436 run osmo-stp_10.42.42.5: Starting osmo-stp 22:27:46.410792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21818): Launched 22:27:46.741798 run osmo-stp_10.42.42.5(pid=21819): Launched 22:27:46.902950 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:27:47.587168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21821): Launched 22:27:47.700370 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:27:47.950892 run patchelf(pid=21822): Launched 22:27:48.115925 run osmo-stp_10.42.42.5(pid=21819): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21819)] 22:27:48.243150 run osmo-stp_10.42.42.5(pid=21819): stdout: | (launched: 2022-12-08_22:27:46.673969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:48.371519 run osmo-stp_10.42.42.5(pid=21819): stderr: | 20221208222747020 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222747020 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222747020 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222747021 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222747021 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222747021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222747021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:48.500270 run osmo-stp_10.42.42.5(pid=21819): stdout: | (launched: 2022-12-08_22:27:46.673969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:48.623182 run osmo-stp_10.42.42.5(pid=21819): stderr: | 20221208222747020 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222747020 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222747020 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222747021 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222747021 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222747021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222747021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:48.768848 run patchelf(pid=21822): Terminating (SIGINT) 22:27:48.937157 run patchelf(pid=21822): Terminated: ok {rc=0} 22:27:49.058364 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21819): Process ended prematurely: osmo-stp_10.42.42.5(pid=21819) [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21819)] [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 22:27:49.067364 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 22:27:49.094946 run osmo-hlr_10.42.42.2(pid=21816): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21816)] 22:27:49.143866 run osmo-hlr_10.42.42.2(pid=21816): stdout: | (launched: 2022-12-08_22:27:45.631101) 22:27:49.194739 run osmo-hlr_10.42.42.2(pid=21816): stderr: | 20221208222745827 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222745828 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222745828 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222745828 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222745828 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222745828 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222745841 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222745859 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222745859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222745859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:27:49.245905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21815): Terminating (SIGTERM) 22:27:49.286584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21818): Terminating (SIGTERM) 22:27:49.327362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21821): Terminating (SIGTERM) 22:27:49.368311 --- ParallelTerminationStrategy: PID 21815 died... 22:27:49.387738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21815): Terminated: ok {rc=0} 22:27:49.433131 --- ParallelTerminationStrategy: PID 21818 died... 22:27:49.452035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21818): Terminated: ok {rc=0} 22:27:49.497888 --- ParallelTerminationStrategy: PID 21821 died... 22:27:49.517051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21821): Terminated: ok {rc=0} 22:27:49.605074 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 22:27:50.905957 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:27:50.912758 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 22:27:50.945584 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 22:27:50.983482 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 22:27:51.068339 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 22:27:51.100328 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 22:27:51.138383 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 22:27:51.743023 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 22:27:51.791685 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:51.802943 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:27:51.854966 tst cs_paging_gprs_active.py: using LAC 17173 22:27:51.983270 tst cs_paging_gprs_active.py: using RAC 88 22:27:52.108907 tst cs_paging_gprs_active.py: using CellId 17173 22:27:52.238697 tst cs_paging_gprs_active.py: using BVCI 17174 22:27:52.358134 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:52.369961 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:52.381429 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:52.392800 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:52.404234 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:52.415571 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:52.427065 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:52.438405 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:52.450147 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:27:52.566080 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:27:52.685696 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:27:52.901867 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:27:53.224588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21827): Launched 22:27:53.503508 run iperf3-srv_10.42.42.10(pid=21828): Launched 22:27:53.623854 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:27:53.840277 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:27:54.161944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21829): Launched 22:27:54.441947 run iperf3-srv_10.42.42.10(pid=21830): Launched 22:27:54.562798 tst cs_paging_gprs_active.py:38: start network... 22:27:54.779235 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:27:55.279517 run create_hlr_db(pid=21831): Launched 22:27:55.410892 bus /gobi_6: Setting Powered False 22:27:56.475641 run create_hlr_db(pid=21831): Terminated: ok {rc=0} 22:27:56.909206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21833): Launched 22:27:57.212483 run osmo-hlr_10.42.42.2(pid=21834): Launched 22:27:57.328400 run osmo-stp_10.42.42.5: Starting osmo-stp 22:27:57.849287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21836): Launched 22:27:58.169111 run osmo-stp_10.42.42.5(pid=21837): Launched 22:27:58.291460 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:27:58.846053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21839): Launched 22:27:58.968528 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:27:59.240360 run patchelf(pid=21840): Launched 22:27:59.419289 run osmo-stp_10.42.42.5(pid=21837): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21837)] 22:27:59.555239 run osmo-stp_10.42.42.5(pid=21837): stdout: | (launched: 2022-12-08_22:27:58.111406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:59.693050 run osmo-stp_10.42.42.5(pid=21837): stderr: | 20221208222758304 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222758304 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222758304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222758305 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222758305 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222758305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222758306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:59.830728 run osmo-stp_10.42.42.5(pid=21837): stdout: | (launched: 2022-12-08_22:27:58.111406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:59.963162 run osmo-stp_10.42.42.5(pid=21837): stderr: | 20221208222758304 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222758304 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222758304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222758305 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222758305 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222758305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222758306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:00.119669 run patchelf(pid=21840): Terminating (SIGINT) 22:28:00.299861 run patchelf(pid=21840): Terminated: ok {rc=0} 22:28:00.430052 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21837): Process ended prematurely: osmo-stp_10.42.42.5(pid=21837) [trial-2350↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21837)] [trial-2350↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 22:28:00.440296 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:28:00.469176 run osmo-hlr_10.42.42.2(pid=21834): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21834)] 22:28:00.519957 run osmo-hlr_10.42.42.2(pid=21834): stdout: | (launched: 2022-12-08_22:27:57.157587) 22:28:00.572450 run osmo-hlr_10.42.42.2(pid=21834): stderr: | 20221208222757333 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222757334 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222757334 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222757334 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222757334 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222757334 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222757346 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222757354 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222757354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222757354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:28:00.625551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21827): Terminating (SIGTERM) 22:28:00.667716 run iperf3-srv_10.42.42.10(pid=21828): Terminating (SIGTERM) 22:28:00.711153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21829): Terminating (SIGTERM) 22:28:00.753571 run iperf3-srv_10.42.42.10(pid=21830): Terminating (SIGTERM) 22:28:00.795634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21833): Terminating (SIGTERM) 22:28:00.840703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21836): Terminating (SIGTERM) 22:28:00.903378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21839): Terminating (SIGTERM) 22:28:00.961758 --- ParallelTerminationStrategy: PID 21827 died... 22:28:00.990002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21827): Terminated: ok {rc=0} 22:28:01.050264 --- ParallelTerminationStrategy: PID 21828 died... 22:28:01.070215 run iperf3-srv_10.42.42.10(pid=21828): Terminated {rc=256} 22:28:01.118643 --- ParallelTerminationStrategy: PID 21829 died... 22:28:01.138763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21829): Terminated: ok {rc=0} 22:28:01.188272 --- ParallelTerminationStrategy: PID 21830 died... 22:28:01.208330 run iperf3-srv_10.42.42.10(pid=21830): Terminated {rc=256} 22:28:01.257930 --- ParallelTerminationStrategy: PID 21833 died... 22:28:01.278382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21833): Terminated: ok {rc=0} 22:28:01.327171 --- ParallelTerminationStrategy: PID 21836 died... 22:28:01.347849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21836): Terminated: ok {rc=0} 22:28:01.396580 --- ParallelTerminationStrategy: PID 21839 died... 22:28:01.416762 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21839): Terminated: ok {rc=0} 22:28:01.510320 bus /gobi_0: Setting Powered False 22:28:02.609397 bus /gobi_0: Setting Powered False 22:28:03.726284 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 22:28:04.878478 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:04.890808 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:28:04.945316 tst iperf3.py: using LAC 17174 22:28:05.079832 tst iperf3.py: using RAC 89 22:28:05.212617 tst iperf3.py: using CellId 17174 22:28:05.331960 tst iperf3.py: using BVCI 17175 22:28:05.441839 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:05.453229 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:05.464224 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:05.475414 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:05.486579 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:05.497862 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:05.509160 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:05.520323 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:05.531722 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:28:05.645621 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:28:05.847086 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:28:06.149369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21841): Launched 22:28:06.410843 run iperf3-srv_10.42.42.10(pid=21842): Launched 22:28:06.524085 tst iperf3.py:8: start network... 22:28:06.726028 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:28:07.192679 run create_hlr_db(pid=21843): Launched 22:28:07.307658 bus /gobi_6: Setting Powered False 22:28:08.368389 run create_hlr_db(pid=21843): Terminated: ok {rc=0} 22:28:08.787719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21845): Launched 22:28:09.088727 run osmo-hlr_10.42.42.2(pid=21846): Launched 22:28:09.204157 run osmo-stp_10.42.42.5: Starting osmo-stp 22:28:09.726824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21848): Launched 22:28:10.027101 run osmo-stp_10.42.42.5(pid=21849): Launched 22:28:10.142554 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:28:10.662491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21851): Launched 22:28:10.777864 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:28:11.033368 run patchelf(pid=21852): Launched 22:28:11.201359 run osmo-stp_10.42.42.5(pid=21849): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21849)] 22:28:11.329422 run osmo-stp_10.42.42.5(pid=21849): stdout: | (launched: 2022-12-08_22:28:09.972277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:11.459548 run osmo-stp_10.42.42.5(pid=21849): stderr: | 20221208222810143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222810143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222810144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222810144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222810144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222810144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222810145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:11.589148 run osmo-stp_10.42.42.5(pid=21849): stdout: | (launched: 2022-12-08_22:28:09.972277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:11.713562 run osmo-stp_10.42.42.5(pid=21849): stderr: | 20221208222810143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222810143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222810144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222810144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222810144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222810144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222810145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:11.861104 run patchelf(pid=21852): Terminating (SIGINT) 22:28:12.031337 run patchelf(pid=21852): Terminated: ok {rc=0} 22:28:12.154273 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21849): Process ended prematurely: osmo-stp_10.42.42.5(pid=21849) [trial-2350↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21849)] [trial-2350↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 22:28:12.163783 tst iperf3.py:8: Test FAILED (7.3 sec) 22:28:12.191823 run osmo-hlr_10.42.42.2(pid=21846): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21846)] 22:28:12.240187 run osmo-hlr_10.42.42.2(pid=21846): stdout: | (launched: 2022-12-08_22:28:09.034062) 22:28:12.290371 run osmo-hlr_10.42.42.2(pid=21846): stderr: | 20221208222809207 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222809207 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222809207 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222809208 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222809208 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222809208 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222809220 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222809228 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222809229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222809229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:28:12.341104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21841): Terminating (SIGTERM) 22:28:12.381549 run iperf3-srv_10.42.42.10(pid=21842): Terminating (SIGTERM) 22:28:12.421900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21845): Terminating (SIGTERM) 22:28:12.462535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21848): Terminating (SIGTERM) 22:28:12.503003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21851): Terminating (SIGTERM) 22:28:12.543493 --- ParallelTerminationStrategy: PID 21841 died... 22:28:12.562660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21841): Terminated: ok {rc=0} 22:28:12.607549 --- ParallelTerminationStrategy: PID 21842 died... 22:28:12.626182 run iperf3-srv_10.42.42.10(pid=21842): Terminated {rc=256} 22:28:12.670735 --- ParallelTerminationStrategy: PID 21845 died... 22:28:12.689364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21845): Terminated: ok {rc=0} 22:28:12.734475 --- ParallelTerminationStrategy: PID 21848 died... 22:28:12.753187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21848): Terminated: ok {rc=0} 22:28:12.797981 --- ParallelTerminationStrategy: PID 21851 died... 22:28:12.816718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21851): Terminated: ok {rc=0} 22:28:12.901685 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 22:28:14.052316 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:14.064756 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:28:14.119404 tst iperf3m4.py: using LAC 17175 22:28:14.252430 tst iperf3m4.py: using RAC 90 22:28:14.378954 tst iperf3m4.py: using CellId 17175 22:28:14.505949 tst iperf3m4.py: using BVCI 17176 22:28:14.623520 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:14.635241 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:14.646695 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:14.658407 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:14.670162 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:14.681751 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:14.693469 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:14.705107 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:14.717466 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:28:14.833627 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:28:14.950518 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:28:15.070160 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:28:15.187050 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:28:15.389831 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:28:15.692493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21853): Launched 22:28:15.990602 run iperf3-srv_10.42.42.10(pid=21854): Launched 22:28:16.117678 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:28:16.323744 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:28:16.637845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21855): Launched 22:28:16.957753 run iperf3-srv_10.42.42.10(pid=21856): Launched 22:28:17.076896 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:28:17.283720 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:28:17.588304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21857): Launched 22:28:17.851080 run iperf3-srv_10.42.42.10(pid=21858): Launched 22:28:17.964113 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:28:18.165287 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:28:18.467349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21859): Launched 22:28:18.729313 run iperf3-srv_10.42.42.10(pid=21860): Launched 22:28:18.842650 tst iperf3m4.py:8: start network... 22:28:19.043232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:28:19.510578 run create_hlr_db(pid=21861): Launched 22:28:19.626220 bus /gobi_6: Setting Powered False 22:28:20.686480 run create_hlr_db(pid=21861): Terminated: ok {rc=0} 22:28:21.107790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21863): Launched 22:28:21.409875 run osmo-hlr_10.42.42.2(pid=21864): Launched 22:28:21.524723 run osmo-stp_10.42.42.5: Starting osmo-stp 22:28:22.056854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21866): Launched 22:28:22.357370 run osmo-stp_10.42.42.5(pid=21867): Launched 22:28:22.473456 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:28:22.995337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21869): Launched 22:28:23.110921 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:28:23.365972 run patchelf(pid=21870): Launched 22:28:23.534517 run osmo-stp_10.42.42.5(pid=21867): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21867)] 22:28:23.662885 run osmo-stp_10.42.42.5(pid=21867): stdout: | (launched: 2022-12-08_22:28:22.302802) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:23.792463 run osmo-stp_10.42.42.5(pid=21867): stderr: | 20221208222822470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222822471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222822471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222822471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222822472 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222822472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222822472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:23.922959 run osmo-stp_10.42.42.5(pid=21867): stdout: | (launched: 2022-12-08_22:28:22.302802) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:24.047437 run osmo-stp_10.42.42.5(pid=21867): stderr: | 20221208222822470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222822471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222822471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222822471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222822472 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222822472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222822472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:24.195063 run patchelf(pid=21870): Terminating (SIGINT) 22:28:24.365608 run patchelf(pid=21870): Terminated: ok {rc=0} 22:28:24.488352 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21867): Process ended prematurely: osmo-stp_10.42.42.5(pid=21867) [trial-2350↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21867)] [trial-2350↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 22:28:24.497972 tst iperf3m4.py:8: Test FAILED (10.5 sec) 22:28:24.526180 run osmo-hlr_10.42.42.2(pid=21864): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21864)] 22:28:24.575076 run osmo-hlr_10.42.42.2(pid=21864): stdout: | (launched: 2022-12-08_22:28:21.354776) 22:28:24.625901 run osmo-hlr_10.42.42.2(pid=21864): stderr: | 20221208222821529 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222821529 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222821529 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222821529 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222821529 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222821530 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222821541 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222821550 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222821550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222821550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:28:24.676766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21853): Terminating (SIGTERM) 22:28:24.717181 run iperf3-srv_10.42.42.10(pid=21854): Terminating (SIGTERM) 22:28:24.759127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21855): Terminating (SIGTERM) 22:28:24.800158 run iperf3-srv_10.42.42.10(pid=21856): Terminating (SIGTERM) 22:28:24.840662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21857): Terminating (SIGTERM) 22:28:24.881247 run iperf3-srv_10.42.42.10(pid=21858): Terminating (SIGTERM) 22:28:24.921672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21859): Terminating (SIGTERM) 22:28:24.961755 run iperf3-srv_10.42.42.10(pid=21860): Terminating (SIGTERM) 22:28:25.002305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21863): Terminating (SIGTERM) 22:28:25.042689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21866): Terminating (SIGTERM) 22:28:25.083042 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21869): Terminating (SIGTERM) 22:28:25.123668 --- ParallelTerminationStrategy: PID 21853 died... 22:28:25.142875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21853): Terminated: ok {rc=0} 22:28:25.188153 --- ParallelTerminationStrategy: PID 21854 died... 22:28:25.206741 run iperf3-srv_10.42.42.10(pid=21854): Terminated {rc=256} 22:28:25.251442 --- ParallelTerminationStrategy: PID 21855 died... 22:28:25.270421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21855): Terminated: ok {rc=0} 22:28:25.315696 --- ParallelTerminationStrategy: PID 21856 died... 22:28:25.334496 run iperf3-srv_10.42.42.10(pid=21856): Terminated {rc=256} 22:28:25.379616 --- ParallelTerminationStrategy: PID 21857 died... 22:28:25.398359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21857): Terminated: ok {rc=0} 22:28:25.442935 --- ParallelTerminationStrategy: PID 21858 died... 22:28:25.461851 run iperf3-srv_10.42.42.10(pid=21858): Terminated {rc=256} 22:28:25.506451 --- ParallelTerminationStrategy: PID 21859 died... 22:28:25.525206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21859): Terminated: ok {rc=0} 22:28:25.569626 --- ParallelTerminationStrategy: PID 21860 died... 22:28:25.588234 run iperf3-srv_10.42.42.10(pid=21860): Terminated {rc=256} 22:28:25.632626 --- ParallelTerminationStrategy: PID 21863 died... 22:28:25.651350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21863): Terminated: ok {rc=0} 22:28:25.696085 --- ParallelTerminationStrategy: PID 21866 died... 22:28:25.714768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21866): Terminated: ok {rc=0} 22:28:25.759585 --- ParallelTerminationStrategy: PID 21869 died... 22:28:25.778292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21869): Terminated: ok {rc=0} 22:28:25.864906 bus /gobi_4: Setting Powered False 22:28:26.964647 bus /gobi_4: Setting Powered False 22:28:28.081727 bus /gobi_1: Setting Powered False 22:28:29.181334 bus /gobi_1: Setting Powered False 22:28:30.298863 bus /gobi_0: Setting Powered False 22:28:31.410960 bus /gobi_0: Setting Powered False 22:28:32.545379 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 22:28:33.649356 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:33.661102 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:28:33.713419 tst ping.py: using LAC 17176 22:28:33.830678 tst ping.py: using RAC 91 22:28:33.950018 tst ping.py: using CellId 17176 22:28:34.077132 tst ping.py: using BVCI 17177 22:28:34.192329 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:34.204441 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:34.216045 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:34.228485 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:34.240927 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:34.253111 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:34.265407 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:34.277514 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:28:34.394079 tst ping.py:19: start network... 22:28:34.591170 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:28:35.045307 run create_hlr_db(pid=21872): Launched 22:28:35.157793 bus /gobi_6: Setting Powered False 22:28:36.216724 run create_hlr_db(pid=21872): Terminated: ok {rc=0} 22:28:36.649355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21874): Launched 22:28:36.963190 run osmo-hlr_10.42.42.2(pid=21875): Launched 22:28:37.082489 run osmo-stp_10.42.42.5: Starting osmo-stp 22:28:37.628884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21877): Launched 22:28:37.943573 run osmo-stp_10.42.42.5(pid=21878): Launched 22:28:38.064021 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:28:38.608860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21880): Launched 22:28:38.729201 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:28:38.995165 run patchelf(pid=21881): Launched 22:28:39.170815 run osmo-stp_10.42.42.5(pid=21878): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21878)] 22:28:39.306247 run osmo-stp_10.42.42.5(pid=21878): stdout: | (launched: 2022-12-08_22:28:37.886667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:39.441901 run osmo-stp_10.42.42.5(pid=21878): stderr: | 20221208222838078 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222838078 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222838078 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222838078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222838079 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222838079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222838079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:39.578029 run osmo-stp_10.42.42.5(pid=21878): stdout: | (launched: 2022-12-08_22:28:37.886667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:39.708145 run osmo-stp_10.42.42.5(pid=21878): stderr: | 20221208222838078 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222838078 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222838078 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222838078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222838079 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222838079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222838079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:39.862447 run patchelf(pid=21881): Terminating (SIGINT) 22:28:40.040519 run patchelf(pid=21881): Terminated: ok {rc=0} 22:28:40.168792 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21878): Process ended prematurely: osmo-stp_10.42.42.5(pid=21878) [trial-2350↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21878)] [trial-2350↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 22:28:40.178530 tst ping.py:22: Test FAILED (6.5 sec) 22:28:40.206863 run osmo-hlr_10.42.42.2(pid=21875): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21875)] 22:28:40.257902 run osmo-hlr_10.42.42.2(pid=21875): stdout: | (launched: 2022-12-08_22:28:36.906240) 22:28:40.310523 run osmo-hlr_10.42.42.2(pid=21875): stderr: | 20221208222837105 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222837105 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222837105 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222837105 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222837105 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222837105 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222837118 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222837127 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222837128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222837128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:28:40.363559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21874): Terminating (SIGTERM) 22:28:40.406053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21877): Terminating (SIGTERM) 22:28:40.448560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21880): Terminating (SIGTERM) 22:28:40.491217 --- ParallelTerminationStrategy: PID 21874 died... 22:28:40.511617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21874): Terminated: ok {rc=0} 22:28:40.559450 --- ParallelTerminationStrategy: PID 21877 died... 22:28:40.579433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21877): Terminated: ok {rc=0} 22:28:40.626383 --- ParallelTerminationStrategy: PID 21880 died... 22:28:40.646357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21880): Terminated: ok {rc=0} 22:28:40.734442 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 22:28:41.822540 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:41.835030 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:28:41.889345 tst ping_idle_ping.py: using LAC 17177 22:28:42.014731 tst ping_idle_ping.py: using RAC 92 22:28:42.139876 tst ping_idle_ping.py: using CellId 17177 22:28:42.264388 tst ping_idle_ping.py: using BVCI 17178 22:28:42.379077 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:42.391028 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:42.402555 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:42.414209 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:42.425857 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:42.437599 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:42.449439 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:42.461507 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:28:42.577319 tst ping_idle_ping.py:24: start network... 22:28:42.774765 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:28:43.233897 run create_hlr_db(pid=21882): Launched 22:28:43.348017 bus /gobi_6: Setting Powered False 22:28:44.408193 run create_hlr_db(pid=21882): Terminated: ok {rc=0} 22:28:44.842295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21884): Launched 22:28:45.157596 run osmo-hlr_10.42.42.2(pid=21885): Launched 22:28:45.279001 run osmo-stp_10.42.42.5: Starting osmo-stp 22:28:45.827018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21887): Launched 22:28:46.179968 run osmo-stp_10.42.42.5(pid=21888): Launched 22:28:46.414843 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:28:47.079857 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21890): Launched 22:28:47.209583 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:28:47.461405 run patchelf(pid=21891): Launched 22:28:47.628044 run osmo-stp_10.42.42.5(pid=21888): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21888)] 22:28:47.755577 run osmo-stp_10.42.42.5(pid=21888): stdout: | (launched: 2022-12-08_22:28:46.118765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:47.883864 run osmo-stp_10.42.42.5(pid=21888): stderr: | 20221208222846448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222846448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222846457 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222846458 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222846458 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222846458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222846458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:48.012562 run osmo-stp_10.42.42.5(pid=21888): stdout: | (launched: 2022-12-08_22:28:46.118765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:48.135186 run osmo-stp_10.42.42.5(pid=21888): stderr: | 20221208222846448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222846448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222846457 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222846458 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222846458 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222846458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222846458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:48.279911 run patchelf(pid=21891): Terminating (SIGINT) 22:28:48.447531 run patchelf(pid=21891): Terminated: ok {rc=0} 22:28:48.568450 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21888): Process ended prematurely: osmo-stp_10.42.42.5(pid=21888) [trial-2350↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21888)] [trial-2350↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 22:28:48.577511 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 22:28:48.604505 run osmo-hlr_10.42.42.2(pid=21885): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21885)] 22:28:48.653476 run osmo-hlr_10.42.42.2(pid=21885): stdout: | (launched: 2022-12-08_22:28:45.100490) 22:28:48.703744 run osmo-hlr_10.42.42.2(pid=21885): stderr: | 20221208222845300 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222845300 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222845300 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222845300 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222845300 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222845300 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222845316 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222845325 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222845326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222845326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:28:48.754466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21884): Terminating (SIGTERM) 22:28:48.794854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21887): Terminating (SIGTERM) 22:28:48.835467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21890): Terminating (SIGTERM) 22:28:48.876125 --- ParallelTerminationStrategy: PID 21884 died... 22:28:48.895517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21884): Terminated: ok {rc=0} 22:28:48.941089 --- ParallelTerminationStrategy: PID 21887 died... 22:28:48.959878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21887): Terminated: ok {rc=0} 22:28:49.005125 --- ParallelTerminationStrategy: PID 21890 died... 22:28:49.023948 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21890): Terminated: ok {rc=0} 22:28:49.111404 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:28:50.419401 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:28:50.426220 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:28:50.458991 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:28:50.492995 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:28:50.546531 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:28:50.579112 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:28:50.613094 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:28:51.176157 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2350 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:28:51.182672 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:28:51.194924 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:28:51.267123 tst switch_tch_pdch.py: using LAC 17178 22:28:51.393539 tst switch_tch_pdch.py: using RAC 93 22:28:51.518768 tst switch_tch_pdch.py: using CellId 17178 22:28:51.642546 tst switch_tch_pdch.py: using BVCI 17179 22:28:51.759950 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:28:51.771538 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:28:51.782877 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:28:51.794786 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:28:51.806628 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:28:51.818363 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:28:51.830608 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:28:51.842903 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:28:51.962051 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:28:52.081402 tst switch_tch_pdch.py:51: start network... 22:28:52.292391 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:28:52.778027 run create_hlr_db(pid=21895): Launched 22:28:52.905427 bus /gobi_6: Setting Powered False 22:28:53.967815 run create_hlr_db(pid=21895): Terminated: ok {rc=0} 22:28:54.390623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21897): Launched 22:28:54.685603 run osmo-hlr_10.42.42.2(pid=21898): Launched 22:28:54.798772 run osmo-stp_10.42.42.5: Starting osmo-stp 22:28:55.320667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21900): Launched 22:28:55.615126 run osmo-stp_10.42.42.5(pid=21901): Launched 22:28:55.728275 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:28:56.238306 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21903): Launched 22:28:56.351770 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:28:56.601724 run patchelf(pid=21904): Launched 22:28:56.766227 run osmo-stp_10.42.42.5(pid=21901): ERR: Terminated: ERROR {rc=1} [trial-2350↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21901)] 22:28:56.892886 run osmo-stp_10.42.42.5(pid=21901): stdout: | (launched: 2022-12-08_22:28:55.561458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:57.021187 run osmo-stp_10.42.42.5(pid=21901): stderr: | 20221208222855731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222855731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222855732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222855732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222855734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222855734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222855734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:57.149733 run osmo-stp_10.42.42.5(pid=21901): stdout: | (launched: 2022-12-08_22:28:55.561458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:57.272690 run osmo-stp_10.42.42.5(pid=21901): stderr: | 20221208222855731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222855731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222855732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222855732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222855734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222855734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222855734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:57.418141 run patchelf(pid=21904): Terminating (SIGINT) 22:28:57.586066 run patchelf(pid=21904): Terminated: ok {rc=0} 22:28:57.706942 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21901): Process ended prematurely: osmo-stp_10.42.42.5(pid=21901) [trial-2350↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21901)] [trial-2350↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:28:57.716139 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 22:28:57.744214 run osmo-hlr_10.42.42.2(pid=21898): ERR: Terminated: ERROR {rc=237} [trial-2350↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21898)] 22:28:57.793616 run osmo-hlr_10.42.42.2(pid=21898): stdout: | (launched: 2022-12-08_22:28:54.631567) 22:28:57.844594 run osmo-hlr_10.42.42.2(pid=21898): stderr: | 20221208222854806 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222854806 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222854806 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222854806 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222854807 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222854807 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222854819 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222854830 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222854830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222854830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:28:57.896158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21897): Terminating (SIGTERM) 22:28:57.937238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21900): Terminating (SIGTERM) 22:28:57.978248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21903): Terminating (SIGTERM) 22:28:58.019677 --- ParallelTerminationStrategy: PID 21897 died... 22:28:58.038986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21897): Terminated: ok {rc=0} 22:28:58.084694 --- ParallelTerminationStrategy: PID 21900 died... 22:28:58.103656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21900): Terminated: ok {rc=0} 22:28:58.149512 --- ParallelTerminationStrategy: PID 21903 died... 22:28:58.168454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21903): Terminated: ok {rc=0} 22:28:58.254354 bus /gobi_0: Setting Powered False 22:28:59.350862 bus /gobi_0: Setting Powered False 22:29:00.464467 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 22:29:01.722421 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:29:01.729031 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 22:29:01.764304 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 22:29:01.801039 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 22:29:01.856527 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 22:29:01.909129 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 22:29:01.960557 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 22:29:02.478793 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2350 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 22:29:02.484849 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:29:02.496382 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 22:29:02.565461 tst switch_tch_pdch.py: using LAC 17179 22:29:02.689431 tst switch_tch_pdch.py: using RAC 94 22:29:02.805729 tst switch_tch_pdch.py: using CellId 17179 22:29:02.920756 tst switch_tch_pdch.py: using BVCI 17180 22:29:03.029121 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:29:03.040112 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:29:03.050780 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:29:03.062669 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:29:03.074186 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:29:03.085743 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:29:03.097308 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:29:03.108652 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:29:03.227640 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:29:03.343950 tst switch_tch_pdch.py:51: start network... 22:29:03.541493 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:29:03.974221 run create_hlr_db(pid=21908): Launched 22:29:04.086539 bus /gobi_6: Setting Powered False 22:29:05.149454 run create_hlr_db(pid=21908): Terminated: ok {rc=0} 22:29:05.563204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21910): Launched 22:29:05.879181 run osmo-hlr_10.42.42.2(pid=21911): Launched 22:29:05.998791 run osmo-stp_10.42.42.5: Starting osmo-stp 22:29:06.518363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21913): Launched 22:29:06.831993 run osmo-stp_10.42.42.5(pid=21914): Launched 22:29:06.950499 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:29:07.468669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21916): Launched 22:29:07.589346 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:29:07.857302 run patchelf(pid=21917): Launched 22:29:08.033039 run osmo-stp_10.42.42.5(pid=21914): ERR: Terminated: ERROR {rc=1} [trial-2350↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21914)] 22:29:08.167416 run osmo-stp_10.42.42.5(pid=21914): stdout: | (launched: 2022-12-08_22:29:06.775437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:08.303322 run osmo-stp_10.42.42.5(pid=21914): stderr: | 20221208222906965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222906965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222906965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222906966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222906966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222906966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222906966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:08.439306 run osmo-stp_10.42.42.5(pid=21914): stdout: | (launched: 2022-12-08_22:29:06.775437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:08.568591 run osmo-stp_10.42.42.5(pid=21914): stderr: | 20221208222906965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222906965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222906965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222906966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222906966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222906966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222906966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:08.722256 run patchelf(pid=21917): Terminating (SIGINT) 22:29:08.899060 run patchelf(pid=21917): Terminated: ok {rc=0} 22:29:09.026089 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21914): Process ended prematurely: osmo-stp_10.42.42.5(pid=21914) [trial-2350↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21914)] [trial-2350↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 22:29:09.035672 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 22:29:09.063757 run osmo-hlr_10.42.42.2(pid=21911): ERR: Terminated: ERROR {rc=237} [trial-2350↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21911)] 22:29:09.114188 run osmo-hlr_10.42.42.2(pid=21911): stdout: | (launched: 2022-12-08_22:29:05.822161) 22:29:09.166769 run osmo-hlr_10.42.42.2(pid=21911): stderr: | 20221208222906018 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222906018 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222906018 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222906018 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222906018 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222906018 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222906031 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222906041 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222906041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222906041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:29:09.219581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21910): Terminating (SIGTERM) 22:29:09.262387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21913): Terminating (SIGTERM) 22:29:09.305084 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21916): Terminating (SIGTERM) 22:29:09.347833 --- ParallelTerminationStrategy: PID 21910 died... 22:29:09.367947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21910): Terminated: ok {rc=0} 22:29:09.415298 --- ParallelTerminationStrategy: PID 21913 died... 22:29:09.435034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21913): Terminated: ok {rc=0} 22:29:09.481617 --- ParallelTerminationStrategy: PID 21916 died... 22:29:09.501431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21916): Terminated: ok {rc=0} 22:29:09.590023 bus /gobi_0: Setting Powered False 22:29:10.690352 bus /gobi_0: Setting Powered False 22:29:11.808540 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 nitb_sms:trx-lms --------------------------------------------------------------------- 22:29:13.058743 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:29:13.062967 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 22:29:13.096565 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 22:29:13.103535 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 22:29:13.154158 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 22:29:13.187834 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 22:29:13.194683 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 22:29:13.731269 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 22:29:13.736872 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 22:29:13.747786 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 22:29:13.796381 tst mo_mt_sms.py: using LAC 17180 22:29:13.913795 tst mo_mt_sms.py: using RAC 95 22:29:14.029108 tst mo_mt_sms.py: using CellId 17180 22:29:14.144016 tst mo_mt_sms.py: using BVCI 17181 22:29:14.251706 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 22:29:14.368452 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 22:29:14.483640 tst mo_mt_sms.py:9: start nitb and bts... 22:29:14.696702 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:29:15.336584 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21921): Launched 22:29:15.651498 run osmo-nitb_10.42.42.2(pid=21922): Launched 22:29:15.825603 run osmo-nitb_10.42.42.2(pid=21922): ERR: Terminated: ERROR {rc=2} [trial-2350↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21922)] 22:29:15.984538 run osmo-nitb_10.42.42.2(pid=21922): stdout: | (launched: 2022-12-08_22:29:15.593938) 22:29:16.124562 run osmo-nitb_10.42.42.2(pid=21922): stderr: | (launched: 2022-12-08_22:29:15.640940) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:29:16.266134 run osmo-nitb_10.42.42.2(pid=21922): stdout: | (launched: 2022-12-08_22:29:15.593938) 22:29:16.400026 run osmo-nitb_10.42.42.2(pid=21922): stderr: | (launched: 2022-12-08_22:29:15.640940) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3c9519268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21922): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21922) [trial-2350↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21922)] 22:29:16.768775 tst osmo-nitb_10.42.42.2(pid=21922): stdout: | (launched: 2022-12-08_22:29:15.593938) 22:29:16.936873 tst osmo-nitb_10.42.42.2(pid=21922): stderr: | (launched: 2022-12-08_22:29:15.640940) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:29:17.106980 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=21922): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21922) [trial-2350↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21922)] [trial-2350↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 22:29:17.115864 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 22:29:17.122903 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21921): Terminating (SIGTERM) 22:29:17.336220 --- ParallelTerminationStrategy: PID 21921 died... 22:29:17.357863 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21921): Terminated: ok {rc=0} 22:29:17.446801 bus /sierra_3: Setting Powered False 22:29:18.550494 bus /sierra_3: Setting Powered False 22:29:19.669658 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 sms:trx-lms --------------------------------------------------------------------- 22:29:20.869913 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:29:20.874438 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 22:29:20.907900 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 22:29:20.935151 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 22:29:20.987843 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 22:29:21.021858 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 22:29:21.049346 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 22:29:21.594848 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 22:29:21.599955 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:21.610998 tst sms:trx-lms: Using 1 x bts (candidates: 1) 22:29:21.658715 tst mo_mt_sms.py: using LAC 17181 22:29:21.784212 tst mo_mt_sms.py: using RAC 96 22:29:21.908601 tst mo_mt_sms.py: using CellId 17181 22:29:22.032287 tst mo_mt_sms.py: using BVCI 17182 22:29:22.145990 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:22.156658 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:22.167442 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:22.178175 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:22.188813 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:22.199622 tst sms:trx-lms: Using 1 x modem (candidates: 2) 22:29:22.312047 tst sms:trx-lms: Using 1 x modem (candidates: 2) 22:29:22.426201 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:29:22.882966 run create_hlr_db(pid=21926): Launched 22:29:22.996277 bus /sierra_2: Setting Powered False 22:29:24.055742 run create_hlr_db(pid=21926): Terminated: ok {rc=0} 22:29:24.488695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21928): Launched 22:29:24.803175 run osmo-hlr_10.42.42.2(pid=21929): Launched 22:29:24.922166 run osmo-stp_10.42.42.5: Starting osmo-stp 22:29:25.440882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21931): Launched 22:29:25.733985 run osmo-stp_10.42.42.5(pid=21932): Launched 22:29:25.847040 run osmo-msc_10.42.42.6: Starting osmo-msc 22:29:26.380682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21934): Launched 22:29:26.676175 run osmo-msc_10.42.42.6(pid=21935): Launched 22:29:26.840856 run osmo-stp_10.42.42.5(pid=21932): ERR: Terminated: ERROR {rc=1} [trial-2350↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21932)] 22:29:26.966927 run osmo-stp_10.42.42.5(pid=21932): stdout: | (launched: 2022-12-08_22:29:25.680770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:27.092493 run osmo-stp_10.42.42.5(pid=21932): stderr: | 20221208222925851 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222925851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222925851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222925851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222925852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222925852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222925852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:27.216532 run osmo-stp_10.42.42.5(pid=21932): stdout: | (launched: 2022-12-08_22:29:25.680770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:27.334557 run osmo-stp_10.42.42.5(pid=21932): stderr: | 20221208222925851 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222925851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222925851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222925851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222925852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222925852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222925852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:27.475611 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=21932): Process ended prematurely: osmo-stp_10.42.42.5(pid=21932) [trial-2350↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21932)] [trial-2350↪sms:trx-lms↪mo_mt_sms.py:16] 22:29:27.484035 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 22:29:27.511146 run osmo-hlr_10.42.42.2(pid=21929): ERR: Terminated: ERROR {rc=237} [trial-2350↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21929)] 22:29:27.559730 run osmo-hlr_10.42.42.2(pid=21929): stdout: | (launched: 2022-12-08_22:29:24.746387) 22:29:27.610265 run osmo-hlr_10.42.42.2(pid=21929): stderr: | 20221208222924944 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222924944 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222924944 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222924944 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222924944 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222924944 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222924958 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222924966 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222924966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222924966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:29:27.680135 run osmo-msc_10.42.42.6(pid=21935): ERR: Terminated: ERROR {rc=2} [trial-2350↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21935)] 22:29:27.728667 run osmo-msc_10.42.42.6(pid=21935): stdout: | (launched: 2022-12-08_22:29:26.622669) 22:29:27.778796 run osmo-msc_10.42.42.6(pid=21935): stderr: | 20221208222926890 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208222926890 DLGLOBAL DEBUG validating counter group 0x7ff16a7e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208222926890 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208222926890 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208222926891 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208222926891 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208222926893 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208222926893 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208222926893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208222926893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:29:27.829401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21928): Terminating (SIGTERM) 22:29:27.870084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21931): Terminating (SIGTERM) 22:29:27.910612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21934): Terminating (SIGTERM) 22:29:27.951347 --- ParallelTerminationStrategy: PID 21928 died... 22:29:27.970645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21928): Terminated: ok {rc=0} 22:29:28.015499 --- ParallelTerminationStrategy: PID 21931 died... 22:29:28.034191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21931): Terminated: ok {rc=0} 22:29:28.078903 --- ParallelTerminationStrategy: PID 21934 died... 22:29:28.097488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21934): Terminated: ok {rc=0} 22:29:28.184224 bus /sierra_3: Setting Powered False 22:29:29.284843 bus /sierra_3: Setting Powered False 22:29:30.402729 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 nitb_ussd:trx-lms --------------------------------------------------------------------- 22:29:31.632066 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:29:31.635832 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 22:29:31.673144 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 22:29:31.680808 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 22:29:31.720569 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 22:29:31.764024 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 22:29:31.771626 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 22:29:32.275789 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2350 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 22:29:32.281050 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 22:29:32.292190 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 22:29:32.341575 tst assert_extension.py: using LAC 17182 22:29:32.465552 tst assert_extension.py: using RAC 97 22:29:32.590758 tst assert_extension.py: using CellId 17182 22:29:32.716368 tst assert_extension.py: using BVCI 17183 22:29:32.830535 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 22:29:32.944579 tst assert_extension.py:10: start nitb and bts... 22:29:33.141790 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:29:33.743963 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21940): Launched 22:29:34.038250 run osmo-nitb_10.42.42.2(pid=21941): Launched 22:29:34.202035 run osmo-nitb_10.42.42.2(pid=21941): ERR: Terminated: ERROR {rc=2} [trial-2350↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21941)] 22:29:34.335315 run osmo-nitb_10.42.42.2(pid=21941): stdout: | (launched: 2022-12-08_22:29:33.984238) 22:29:34.470381 run osmo-nitb_10.42.42.2(pid=21941): stderr: | (launched: 2022-12-08_22:29:34.028697) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:29:34.604784 run osmo-nitb_10.42.42.2(pid=21941): stdout: | (launched: 2022-12-08_22:29:33.984238) 22:29:34.734162 run osmo-nitb_10.42.42.2(pid=21941): stderr: | (launched: 2022-12-08_22:29:34.028697) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3c9519268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21941): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21941) [trial-2350↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21941)] 22:29:35.149191 tst osmo-nitb_10.42.42.2(pid=21941): stdout: | (launched: 2022-12-08_22:29:33.984238) 22:29:35.268384 tst osmo-nitb_10.42.42.2(pid=21941): stderr: | (launched: 2022-12-08_22:29:34.028697) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:29:35.409125 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=21941): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21941) [trial-2350↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21941)] [trial-2350↪nitb_ussd:trx-lms↪assert_extension.py:12] 22:29:35.417738 tst assert_extension.py:12: Test FAILED (3.1 sec) 22:29:35.424288 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21940): Terminating (SIGTERM) 22:29:35.634320 --- ParallelTerminationStrategy: PID 21940 died... 22:29:35.655613 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21940): Terminated: ok {rc=0} 22:29:35.743585 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 ussd:trx-lms --------------------------------------------------------------------- 22:29:36.920027 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:29:36.924247 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 22:29:36.957532 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 22:29:36.983859 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 22:29:37.017837 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 22:29:37.050836 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 22:29:37.077835 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 22:29:37.604326 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2350 ussd:trx-lms assert_extension.py ---------------------------------------------- 22:29:37.609631 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:37.619894 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 22:29:37.667463 tst assert_extension.py: using LAC 17183 22:29:37.785913 tst assert_extension.py: using RAC 98 22:29:37.910154 tst assert_extension.py: using CellId 17183 22:29:38.033392 tst assert_extension.py: using BVCI 17184 22:29:38.142024 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:38.152517 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:38.163137 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:38.174347 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:38.185726 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:38.196876 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 22:29:38.309797 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:29:38.766917 run create_hlr_db(pid=21945): Launched 22:29:38.880131 bus /sierra_2: Setting Powered False 22:29:39.940257 run create_hlr_db(pid=21945): Terminated: ok {rc=0} 22:29:40.374986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21947): Launched 22:29:40.691561 run osmo-hlr_10.42.42.2(pid=21948): Launched 22:29:40.812168 run osmo-stp_10.42.42.5: Starting osmo-stp 22:29:41.362023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21950): Launched 22:29:41.676787 run osmo-stp_10.42.42.5(pid=21951): Launched 22:29:41.798009 run osmo-msc_10.42.42.6: Starting osmo-msc 22:29:42.369791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21953): Launched 22:29:42.686818 run osmo-msc_10.42.42.6(pid=21954): Launched 22:29:42.862362 run osmo-stp_10.42.42.5(pid=21951): ERR: Terminated: ERROR {rc=1} [trial-2350↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21951)] 22:29:42.995464 run osmo-stp_10.42.42.5(pid=21951): stdout: | (launched: 2022-12-08_22:29:41.619779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:43.131354 run osmo-stp_10.42.42.5(pid=21951): stderr: | 20221208222941810 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222941810 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222941811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222941811 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222941812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222941812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222941812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:43.264872 run osmo-stp_10.42.42.5(pid=21951): stdout: | (launched: 2022-12-08_22:29:41.619779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:43.392041 run osmo-stp_10.42.42.5(pid=21951): stderr: | 20221208222941810 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222941810 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222941811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222941811 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222941812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222941812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222941812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:43.542974 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=21951): Process ended prematurely: osmo-stp_10.42.42.5(pid=21951) [trial-2350↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21951)] [trial-2350↪ussd:trx-lms↪assert_extension.py:17] 22:29:43.551749 tst assert_extension.py:17: Test FAILED (5.9 sec) 22:29:43.579922 run osmo-hlr_10.42.42.2(pid=21948): ERR: Terminated: ERROR {rc=237} [trial-2350↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21948)] 22:29:43.630768 run osmo-hlr_10.42.42.2(pid=21948): stdout: | (launched: 2022-12-08_22:29:40.634578) 22:29:43.683451 run osmo-hlr_10.42.42.2(pid=21948): stderr: | 20221208222940833 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222940833 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222940834 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222940834 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222940834 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222940834 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222940846 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222940855 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222940856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222940856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:29:43.756491 run osmo-msc_10.42.42.6(pid=21954): ERR: Terminated: ERROR {rc=2} [trial-2350↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21954)] 22:29:43.807378 run osmo-msc_10.42.42.6(pid=21954): stdout: | (launched: 2022-12-08_22:29:42.629319) 22:29:43.859583 run osmo-msc_10.42.42.6(pid=21954): stderr: | 20221208222942948 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208222942948 DLGLOBAL DEBUG validating counter group 0x7f7631919c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208222942948 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208222942948 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208222942948 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208222942949 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208222942950 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208222942951 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208222942951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208222942951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:29:43.912580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21947): Terminating (SIGTERM) 22:29:43.954585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21950): Terminating (SIGTERM) 22:29:43.997060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21953): Terminating (SIGTERM) 22:29:44.039766 --- ParallelTerminationStrategy: PID 21947 died... 22:29:44.059989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21947): Terminated: ok {rc=0} 22:29:44.107359 --- ParallelTerminationStrategy: PID 21950 died... 22:29:44.127255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21950): Terminated: ok {rc=0} 22:29:44.174080 --- ParallelTerminationStrategy: PID 21953 died... 22:29:44.193989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21953): Terminated: ok {rc=0} 22:29:44.283157 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:29:45.498660 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:29:45.506229 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:29:45.540486 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:29:45.567804 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:29:45.620122 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:29:45.653495 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:29:45.680545 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:29:46.251189 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:29:46.321218 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:46.336829 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:29:46.419642 tst mo_mt_call.py: using LAC 17184 22:29:46.570764 tst mo_mt_call.py: using RAC 99 22:29:46.699705 tst mo_mt_call.py: using CellId 17184 22:29:46.826479 tst mo_mt_call.py: using BVCI 17185 22:29:46.966930 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:46.983018 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:46.999370 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:47.015146 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:47.030944 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:47.046586 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:29:47.194572 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:29:47.316000 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:29:47.813653 run create_hlr_db(pid=21959): Launched 22:29:47.944575 bus /sierra_2: Setting Powered False 22:29:49.008795 run create_hlr_db(pid=21959): Terminated: ok {rc=0} 22:29:49.438960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21961): Launched 22:29:49.739993 run osmo-hlr_10.42.42.2(pid=21962): Launched 22:29:49.854476 run osmo-stp_10.42.42.5: Starting osmo-stp 22:29:50.388479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21964): Launched 22:29:50.689561 run osmo-stp_10.42.42.5(pid=21965): Launched 22:29:50.805581 run osmo-msc_10.42.42.6: Starting osmo-msc 22:29:51.351249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21967): Launched 22:29:51.652254 run osmo-msc_10.42.42.6(pid=21968): Launched 22:29:51.820076 run osmo-stp_10.42.42.5(pid=21965): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21965)] 22:29:51.949193 run osmo-stp_10.42.42.5(pid=21965): stdout: | (launched: 2022-12-08_22:29:50.634465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:52.076541 run osmo-stp_10.42.42.5(pid=21965): stderr: | 20221208222950804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222950804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222950804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222950805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222950805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222950805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222950805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:52.203316 run osmo-stp_10.42.42.5(pid=21965): stdout: | (launched: 2022-12-08_22:29:50.634465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:52.323510 run osmo-stp_10.42.42.5(pid=21965): stderr: | 20221208222950804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208222950804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208222950804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208222950805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208222950805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208222950805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208222950805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:52.467355 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21965): Process ended prematurely: osmo-stp_10.42.42.5(pid=21965) [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21965)] [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:29:52.476429 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:29:52.503609 run osmo-hlr_10.42.42.2(pid=21962): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21962)] 22:29:52.552161 run osmo-hlr_10.42.42.2(pid=21962): stdout: | (launched: 2022-12-08_22:29:49.685320) 22:29:52.602677 run osmo-hlr_10.42.42.2(pid=21962): stderr: | 20221208222949862 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222949862 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222949862 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222949862 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222949862 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222949862 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222949874 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222949883 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222949883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222949883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:29:52.672722 run osmo-msc_10.42.42.6(pid=21968): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21968)] 22:29:52.721453 run osmo-msc_10.42.42.6(pid=21968): stdout: | (launched: 2022-12-08_22:29:51.597465) 22:29:52.772118 run osmo-msc_10.42.42.6(pid=21968): stderr: | 20221208222951868 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208222951868 DLGLOBAL DEBUG validating counter group 0x7fb6eafa0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208222951868 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208222951868 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208222951868 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208222951869 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208222951871 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208222951872 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208222951872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208222951872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:29:52.822855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21961): Terminating (SIGTERM) 22:29:52.863276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21964): Terminating (SIGTERM) 22:29:52.903772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21967): Terminating (SIGTERM) 22:29:52.944682 --- ParallelTerminationStrategy: PID 21961 died... 22:29:52.963975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21961): Terminated: ok {rc=0} 22:29:53.009359 --- ParallelTerminationStrategy: PID 21964 died... 22:29:53.028211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21964): Terminated: ok {rc=0} 22:29:53.073784 --- ParallelTerminationStrategy: PID 21967 died... 22:29:53.092869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21967): Terminated: ok {rc=0} 22:29:53.180814 bus /sierra_3: Setting Powered False 22:29:54.280082 bus /sierra_3: Setting Powered False 22:29:55.397456 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:29:56.547302 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:56.559609 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:29:56.635654 tst mo_mt_call_osmux.py: using LAC 17185 22:29:56.761163 tst mo_mt_call_osmux.py: using RAC 100 22:29:56.885320 tst mo_mt_call_osmux.py: using CellId 17185 22:29:57.009649 tst mo_mt_call_osmux.py: using BVCI 17186 22:29:57.126087 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:57.137525 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:57.148578 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:57.159878 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:57.171124 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:57.182347 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:29:57.302815 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:29:57.425406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:29:57.922416 run create_hlr_db(pid=21970): Launched 22:29:58.053431 bus /sierra_2: Setting Powered False 22:29:59.117644 run create_hlr_db(pid=21970): Terminated: ok {rc=0} 22:29:59.549388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21972): Launched 22:29:59.852135 run osmo-hlr_10.42.42.2(pid=21973): Launched 22:29:59.966752 run osmo-stp_10.42.42.5: Starting osmo-stp 22:30:00.498038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21975): Launched 22:30:00.798674 run osmo-stp_10.42.42.5(pid=21976): Launched 22:30:00.989783 run osmo-msc_10.42.42.6: Starting osmo-msc 22:30:01.733788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21981): Launched 22:30:02.127046 run osmo-msc_10.42.42.6(pid=21984): Launched 22:30:02.430475 run osmo-stp_10.42.42.5(pid=21976): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21976)] 22:30:02.567660 run osmo-stp_10.42.42.5(pid=21976): stdout: | (launched: 2022-12-08_22:30:00.744038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:02.704309 run osmo-stp_10.42.42.5(pid=21976): stderr: | 20221208223001001 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223001001 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223001002 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223001002 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223001003 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223001003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223001003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:02.839183 run osmo-stp_10.42.42.5(pid=21976): stdout: | (launched: 2022-12-08_22:30:00.744038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:02.967092 run osmo-stp_10.42.42.5(pid=21976): stderr: | 20221208223001001 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223001001 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223001002 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223001002 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223001003 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223001003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223001003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:03.120803 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21976): Process ended prematurely: osmo-stp_10.42.42.5(pid=21976) [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21976)] [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:30:03.130489 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 22:30:03.158633 run osmo-hlr_10.42.42.2(pid=21973): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21973)] 22:30:03.209523 run osmo-hlr_10.42.42.2(pid=21973): stdout: | (launched: 2022-12-08_22:29:59.797328) 22:30:03.262075 run osmo-hlr_10.42.42.2(pid=21973): stderr: | 20221208222959971 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208222959971 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208222959971 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208222959971 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208222959971 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208222959971 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208222959984 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208222959994 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208222959995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208222959995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:30:03.336226 run osmo-msc_10.42.42.6(pid=21984): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21984)] 22:30:03.387144 run osmo-msc_10.42.42.6(pid=21984): stdout: | (launched: 2022-12-08_22:30:02.063639) 22:30:03.439610 run osmo-msc_10.42.42.6(pid=21984): stderr: | 20221208223002437 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223002437 DLGLOBAL DEBUG validating counter group 0x7fdbb09e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223002437 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223002438 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223002438 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223002438 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223002439 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223002440 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223002440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223002440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:30:03.492440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21972): Terminating (SIGTERM) 22:30:03.534932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21975): Terminating (SIGTERM) 22:30:03.578280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21981): Terminating (SIGTERM) 22:30:03.621168 --- ParallelTerminationStrategy: PID 21972 died... 22:30:03.641600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21972): Terminated: ok {rc=0} 22:30:03.688803 --- ParallelTerminationStrategy: PID 21975 died... 22:30:03.709077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21975): Terminated: ok {rc=0} 22:30:03.756162 --- ParallelTerminationStrategy: PID 21981 died... 22:30:03.776144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21981): Terminated: ok {rc=0} 22:30:03.866064 bus /sierra_3: Setting Powered False 22:30:04.967122 bus /sierra_3: Setting Powered False 22:30:06.084763 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:30:07.338906 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:30:07.346291 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:30:07.379832 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:30:07.407081 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:30:07.459359 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:30:07.492805 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:30:07.519889 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:30:08.071561 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:30:08.122756 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:08.134208 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:30:08.204423 tst mo_mt_call.py: using LAC 17186 22:30:08.331234 tst mo_mt_call.py: using RAC 101 22:30:08.457834 tst mo_mt_call.py: using CellId 17186 22:30:08.585210 tst mo_mt_call.py: using BVCI 17187 22:30:08.702394 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:08.713874 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:08.725196 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:08.736420 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:08.747810 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:08.759170 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:30:08.872749 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:30:08.993155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:30:09.492880 run create_hlr_db(pid=21990): Launched 22:30:09.623851 bus /sierra_2: Setting Powered False 22:30:10.688610 run create_hlr_db(pid=21990): Terminated: ok {rc=0} 22:30:11.119344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21992): Launched 22:30:11.422032 run osmo-hlr_10.42.42.2(pid=21993): Launched 22:30:11.537219 run osmo-stp_10.42.42.5: Starting osmo-stp 22:30:12.071390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21995): Launched 22:30:12.372727 run osmo-stp_10.42.42.5(pid=21996): Launched 22:30:12.487176 run osmo-msc_10.42.42.6: Starting osmo-msc 22:30:13.033051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21998): Launched 22:30:13.335656 run osmo-msc_10.42.42.6(pid=21999): Launched 22:30:13.505146 run osmo-stp_10.42.42.5(pid=21996): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21996)] 22:30:13.634733 run osmo-stp_10.42.42.5(pid=21996): stdout: | (launched: 2022-12-08_22:30:12.318008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:13.764133 run osmo-stp_10.42.42.5(pid=21996): stderr: | 20221208223012489 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223012489 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223012489 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223012490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223012490 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223012490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223012490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:13.891550 run osmo-stp_10.42.42.5(pid=21996): stdout: | (launched: 2022-12-08_22:30:12.318008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:14.012499 run osmo-stp_10.42.42.5(pid=21996): stderr: | 20221208223012489 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223012489 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223012489 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223012490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223012490 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223012490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223012490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:14.157087 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21996): Process ended prematurely: osmo-stp_10.42.42.5(pid=21996) [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21996)] [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:30:14.166246 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:30:14.193539 run osmo-hlr_10.42.42.2(pid=21993): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21993)] 22:30:14.242481 run osmo-hlr_10.42.42.2(pid=21993): stdout: | (launched: 2022-12-08_22:30:11.366699) 22:30:14.293286 run osmo-hlr_10.42.42.2(pid=21993): stderr: | 20221208223011544 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223011544 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223011544 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223011544 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223011544 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223011544 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223011556 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223011565 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223011566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223011566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:30:14.363948 run osmo-msc_10.42.42.6(pid=21999): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21999)] 22:30:14.412669 run osmo-msc_10.42.42.6(pid=21999): stdout: | (launched: 2022-12-08_22:30:13.281142) 22:30:14.463046 run osmo-msc_10.42.42.6(pid=21999): stderr: | 20221208223013551 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223013551 DLGLOBAL DEBUG validating counter group 0x7f89c0e36c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223013551 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223013551 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223013552 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223013552 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223013554 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223013554 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223013554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223013554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:30:14.513690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21992): Terminating (SIGTERM) 22:30:14.554641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21995): Terminating (SIGTERM) 22:30:14.595351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21998): Terminating (SIGTERM) 22:30:14.636333 --- ParallelTerminationStrategy: PID 21992 died... 22:30:14.655565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21992): Terminated: ok {rc=0} 22:30:14.701040 --- ParallelTerminationStrategy: PID 21995 died... 22:30:14.719857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21995): Terminated: ok {rc=0} 22:30:14.765448 --- ParallelTerminationStrategy: PID 21998 died... 22:30:14.784387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21998): Terminated: ok {rc=0} 22:30:14.872348 bus /sierra_3: Setting Powered False 22:30:15.987160 bus /sierra_3: Setting Powered False 22:30:17.107304 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:30:18.256602 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:18.268333 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:30:18.337214 tst mo_mt_call_osmux.py: using LAC 17187 22:30:18.457364 tst mo_mt_call_osmux.py: using RAC 102 22:30:18.575823 tst mo_mt_call_osmux.py: using CellId 17187 22:30:18.696458 tst mo_mt_call_osmux.py: using BVCI 17188 22:30:18.815831 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:18.827464 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:18.838942 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:18.851023 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:18.863157 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:18.875102 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:30:18.992290 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:30:19.114739 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:30:19.616687 run create_hlr_db(pid=22001): Launched 22:30:19.747333 bus /sierra_2: Setting Powered False 22:30:20.811256 run create_hlr_db(pid=22001): Terminated: ok {rc=0} 22:30:21.241143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22003): Launched 22:30:21.542585 run osmo-hlr_10.42.42.2(pid=22004): Launched 22:30:21.657867 run osmo-stp_10.42.42.5: Starting osmo-stp 22:30:22.191615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22006): Launched 22:30:22.493605 run osmo-stp_10.42.42.5(pid=22007): Launched 22:30:22.609706 run osmo-msc_10.42.42.6: Starting osmo-msc 22:30:23.158410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22009): Launched 22:30:23.459650 run osmo-msc_10.42.42.6(pid=22010): Launched 22:30:23.628934 run osmo-stp_10.42.42.5(pid=22007): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22007)] 22:30:23.758023 run osmo-stp_10.42.42.5(pid=22007): stdout: | (launched: 2022-12-08_22:30:22.438753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:23.887574 run osmo-stp_10.42.42.5(pid=22007): stderr: | 20221208223022609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223022609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223022609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223022610 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223022610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223022610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223022610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:24.014136 run osmo-stp_10.42.42.5(pid=22007): stdout: | (launched: 2022-12-08_22:30:22.438753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:24.135396 run osmo-stp_10.42.42.5(pid=22007): stderr: | 20221208223022609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223022609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223022609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223022610 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223022610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223022610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223022610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:24.279932 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22007): Process ended prematurely: osmo-stp_10.42.42.5(pid=22007) [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22007)] [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:30:24.289038 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:30:24.317101 run osmo-hlr_10.42.42.2(pid=22004): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22004)] 22:30:24.366379 run osmo-hlr_10.42.42.2(pid=22004): stdout: | (launched: 2022-12-08_22:30:21.488015) 22:30:24.417759 run osmo-hlr_10.42.42.2(pid=22004): stderr: | 20221208223021661 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223021661 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223021661 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223021661 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223021661 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223021661 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223021674 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223021683 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223021683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223021683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:30:24.488855 run osmo-msc_10.42.42.6(pid=22010): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22010)] 22:30:24.538325 run osmo-msc_10.42.42.6(pid=22010): stdout: | (launched: 2022-12-08_22:30:23.404879) 22:30:24.589295 run osmo-msc_10.42.42.6(pid=22010): stderr: | 20221208223023675 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223023676 DLGLOBAL DEBUG validating counter group 0x7fc79153ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223023676 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223023676 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223023676 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223023676 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223023678 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223023678 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223023678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223023679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:30:24.640507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22003): Terminating (SIGTERM) 22:30:24.681776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22006): Terminating (SIGTERM) 22:30:24.722904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22009): Terminating (SIGTERM) 22:30:24.764192 --- ParallelTerminationStrategy: PID 22003 died... 22:30:24.783793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22003): Terminated: ok {rc=0} 22:30:24.829818 --- ParallelTerminationStrategy: PID 22006 died... 22:30:24.848928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22006): Terminated: ok {rc=0} 22:30:24.894653 --- ParallelTerminationStrategy: PID 22009 died... 22:30:24.913809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22009): Terminated: ok {rc=0} 22:30:25.002064 bus /sierra_3: Setting Powered False 22:30:26.102752 bus /sierra_3: Setting Powered False 22:30:27.216107 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:30:28.478985 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:30:28.486087 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:30:28.519541 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:30:28.546702 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:30:28.597207 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:30:28.630538 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:30:28.657532 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:30:29.210854 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:30:29.261906 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:29.273383 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:30:29.342885 tst mo_mt_call.py: using LAC 17188 22:30:29.467705 tst mo_mt_call.py: using RAC 103 22:30:29.594085 tst mo_mt_call.py: using CellId 17188 22:30:29.718728 tst mo_mt_call.py: using BVCI 17189 22:30:29.835575 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:29.847014 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:29.858261 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:29.869573 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:29.880777 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:29.892043 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:30:30.004677 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:30:30.124612 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:30:30.625689 run create_hlr_db(pid=22016): Launched 22:30:30.756307 bus /sierra_2: Setting Powered False 22:30:31.819882 run create_hlr_db(pid=22016): Terminated: ok {rc=0} 22:30:32.278353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22018): Launched 22:30:32.596035 run osmo-hlr_10.42.42.2(pid=22019): Launched 22:30:32.712118 run osmo-stp_10.42.42.5: Starting osmo-stp 22:30:33.244908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22021): Launched 22:30:33.546395 run osmo-stp_10.42.42.5(pid=22022): Launched 22:30:33.661196 run osmo-msc_10.42.42.6: Starting osmo-msc 22:30:34.207402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22024): Launched 22:30:34.508726 run osmo-msc_10.42.42.6(pid=22025): Launched 22:30:34.676928 run osmo-stp_10.42.42.5(pid=22022): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22022)] 22:30:34.805988 run osmo-stp_10.42.42.5(pid=22022): stdout: | (launched: 2022-12-08_22:30:33.491984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:34.934830 run osmo-stp_10.42.42.5(pid=22022): stderr: | 20221208223033660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223033660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223033660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223033660 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223033661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223033661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223033661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:35.061785 run osmo-stp_10.42.42.5(pid=22022): stdout: | (launched: 2022-12-08_22:30:33.491984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:35.183083 run osmo-stp_10.42.42.5(pid=22022): stderr: | 20221208223033660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223033660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223033660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223033660 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223033661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223033661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223033661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:35.327107 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22022): Process ended prematurely: osmo-stp_10.42.42.5(pid=22022) [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22022)] [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:30:35.336139 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:30:35.363543 run osmo-hlr_10.42.42.2(pid=22019): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22019)] 22:30:35.412890 run osmo-hlr_10.42.42.2(pid=22019): stdout: | (launched: 2022-12-08_22:30:32.541221) 22:30:35.463641 run osmo-hlr_10.42.42.2(pid=22019): stderr: | 20221208223032718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223032718 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223032718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223032718 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223032718 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223032718 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223032730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223032738 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223032739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223032739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:30:35.533809 run osmo-msc_10.42.42.6(pid=22025): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22025)] 22:30:35.582727 run osmo-msc_10.42.42.6(pid=22025): stdout: | (launched: 2022-12-08_22:30:34.453738) 22:30:35.633156 run osmo-msc_10.42.42.6(pid=22025): stderr: | 20221208223034724 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223034724 DLGLOBAL DEBUG validating counter group 0x7f780516fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223034725 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223034725 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223034725 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223034725 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223034727 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223034727 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223034727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223034727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:30:35.684043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22018): Terminating (SIGTERM) 22:30:35.724636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22021): Terminating (SIGTERM) 22:30:35.765440 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22024): Terminating (SIGTERM) 22:30:35.806422 --- ParallelTerminationStrategy: PID 22018 died... 22:30:35.825707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22018): Terminated: ok {rc=0} 22:30:35.871297 --- ParallelTerminationStrategy: PID 22021 died... 22:30:35.890275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22021): Terminated: ok {rc=0} 22:30:35.936487 --- ParallelTerminationStrategy: PID 22024 died... 22:30:35.955508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22024): Terminated: ok {rc=0} 22:30:36.043764 bus /sierra_3: Setting Powered False 22:30:37.144877 bus /sierra_3: Setting Powered False 22:30:38.260914 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:30:39.408822 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:39.420540 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:30:39.489984 tst mo_mt_call_osmux.py: using LAC 17189 22:30:39.614790 tst mo_mt_call_osmux.py: using RAC 104 22:30:39.735286 tst mo_mt_call_osmux.py: using CellId 17189 22:30:39.854785 tst mo_mt_call_osmux.py: using BVCI 17190 22:30:39.965823 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:39.976903 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:39.987751 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:39.998910 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:40.010203 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:40.021778 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:30:40.135966 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:30:40.250859 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:30:40.720158 run create_hlr_db(pid=22027): Launched 22:30:40.835769 bus /sierra_2: Setting Powered False 22:30:41.896193 run create_hlr_db(pid=22027): Terminated: ok {rc=0} 22:30:42.335727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22029): Launched 22:30:42.658668 run osmo-hlr_10.42.42.2(pid=22030): Launched 22:30:42.781391 run osmo-stp_10.42.42.5: Starting osmo-stp 22:30:43.334236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22032): Launched 22:30:43.654812 run osmo-stp_10.42.42.5(pid=22033): Launched 22:30:43.776685 run osmo-msc_10.42.42.6: Starting osmo-msc 22:30:44.357852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22035): Launched 22:30:44.680732 run osmo-msc_10.42.42.6(pid=22036): Launched 22:30:44.859544 run osmo-stp_10.42.42.5(pid=22033): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22033)] 22:30:44.995671 run osmo-stp_10.42.42.5(pid=22033): stdout: | (launched: 2022-12-08_22:30:43.596702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:45.132691 run osmo-stp_10.42.42.5(pid=22033): stderr: | 20221208223043789 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223043790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223043790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223043790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223043791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223043791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223043791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:45.267842 run osmo-stp_10.42.42.5(pid=22033): stdout: | (launched: 2022-12-08_22:30:43.596702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:45.396654 run osmo-stp_10.42.42.5(pid=22033): stderr: | 20221208223043789 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223043790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223043790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223043790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223043791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223043791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223043791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:45.549862 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22033): Process ended prematurely: osmo-stp_10.42.42.5(pid=22033) [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22033)] [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:30:45.559554 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:30:45.588016 run osmo-hlr_10.42.42.2(pid=22030): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22030)] 22:30:45.639155 run osmo-hlr_10.42.42.2(pid=22030): stdout: | (launched: 2022-12-08_22:30:42.600504) 22:30:45.692027 run osmo-hlr_10.42.42.2(pid=22030): stderr: | 20221208223042799 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223042799 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223042800 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223042800 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223042800 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223042800 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223042812 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223042820 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223042820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223042820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:30:45.765602 run osmo-msc_10.42.42.6(pid=22036): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22036)] 22:30:45.816235 run osmo-msc_10.42.42.6(pid=22036): stdout: | (launched: 2022-12-08_22:30:44.622467) 22:30:45.873533 run osmo-msc_10.42.42.6(pid=22036): stderr: | 20221208223044942 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223044942 DLGLOBAL DEBUG validating counter group 0x7fdda23b3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223044942 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223044942 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223044942 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223044943 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223044944 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223044945 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223044945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223044945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:30:45.929704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22029): Terminating (SIGTERM) 22:30:45.976663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22032): Terminating (SIGTERM) 22:30:46.020709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22035): Terminating (SIGTERM) 22:30:46.065152 --- ParallelTerminationStrategy: PID 22029 died... 22:30:46.085874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22029): Terminated: ok {rc=0} 22:30:46.134460 --- ParallelTerminationStrategy: PID 22032 died... 22:30:46.155235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22032): Terminated: ok {rc=0} 22:30:46.203420 --- ParallelTerminationStrategy: PID 22035 died... 22:30:46.223838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22035): Terminated: ok {rc=0} 22:30:46.315776 bus /sierra_3: Setting Powered False 22:30:47.417253 bus /sierra_3: Setting Powered False 22:30:48.534651 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 22:30:49.781042 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:30:49.787381 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 22:30:49.820558 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 22:30:49.846995 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 22:30:49.899411 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 22:30:49.932026 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 22:30:49.958267 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 22:30:50.512040 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 22:30:50.564426 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:30:50.576029 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:30:50.646540 tst mo_mt_call.py: using LAC 17190 22:30:50.773011 tst mo_mt_call.py: using RAC 105 22:30:50.897857 tst mo_mt_call.py: using CellId 17190 22:30:51.027146 tst mo_mt_call.py: using BVCI 17191 22:30:51.145598 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:30:51.157450 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:30:51.168836 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:30:51.180283 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:30:51.191888 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:30:51.203435 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:30:51.323077 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:30:51.437362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:30:51.904706 run create_hlr_db(pid=22041): Launched 22:30:52.021555 bus /sierra_2: Setting Powered False 22:30:53.081916 run create_hlr_db(pid=22041): Terminated: ok {rc=0} 22:30:53.502539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22043): Launched 22:30:53.803272 run osmo-hlr_10.42.42.2(pid=22044): Launched 22:30:53.918624 run osmo-stp_10.42.42.5: Starting osmo-stp 22:30:54.452169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22046): Launched 22:30:54.754167 run osmo-stp_10.42.42.5(pid=22047): Launched 22:30:54.871923 run osmo-msc_10.42.42.6: Starting osmo-msc 22:30:55.419111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22049): Launched 22:30:55.720767 run osmo-msc_10.42.42.6(pid=22050): Launched 22:30:55.889938 run osmo-stp_10.42.42.5(pid=22047): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22047)] 22:30:56.019158 run osmo-stp_10.42.42.5(pid=22047): stdout: | (launched: 2022-12-08_22:30:54.699030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:56.147493 run osmo-stp_10.42.42.5(pid=22047): stderr: | 20221208223054870 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223054870 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223054871 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223054871 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223054871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223054872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223054872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:56.274200 run osmo-stp_10.42.42.5(pid=22047): stdout: | (launched: 2022-12-08_22:30:54.699030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:56.394942 run osmo-stp_10.42.42.5(pid=22047): stderr: | 20221208223054870 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223054870 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223054871 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223054871 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223054871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223054872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223054872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:56.539504 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22047): Process ended prematurely: osmo-stp_10.42.42.5(pid=22047) [trial-2350↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22047)] [trial-2350↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 22:30:56.548576 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:30:56.576077 run osmo-hlr_10.42.42.2(pid=22044): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22044)] 22:30:56.625092 run osmo-hlr_10.42.42.2(pid=22044): stdout: | (launched: 2022-12-08_22:30:53.748426) 22:30:56.676087 run osmo-hlr_10.42.42.2(pid=22044): stderr: | 20221208223053925 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223053925 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223053925 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223053925 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223053925 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223053925 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223053937 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223053947 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223053947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223053947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:30:56.746575 run osmo-msc_10.42.42.6(pid=22050): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22050)] 22:30:56.795458 run osmo-msc_10.42.42.6(pid=22050): stdout: | (launched: 2022-12-08_22:30:55.665595) 22:30:56.846067 run osmo-msc_10.42.42.6(pid=22050): stderr: | 20221208223055935 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223055935 DLGLOBAL DEBUG validating counter group 0x7ff4fb73cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223055935 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223055935 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223055935 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223055936 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223055937 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223055938 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223055938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223055938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:30:56.897033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22043): Terminating (SIGTERM) 22:30:56.937313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22046): Terminating (SIGTERM) 22:30:56.977767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22049): Terminating (SIGTERM) 22:30:57.018631 --- ParallelTerminationStrategy: PID 22043 died... 22:30:57.037933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22043): Terminated: ok {rc=0} 22:30:57.083385 --- ParallelTerminationStrategy: PID 22046 died... 22:30:57.102370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22046): Terminated: ok {rc=0} 22:30:57.147846 --- ParallelTerminationStrategy: PID 22049 died... 22:30:57.166876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22049): Terminated: ok {rc=0} 22:30:57.254797 bus /sierra_3: Setting Powered False 22:30:58.355321 bus /sierra_3: Setting Powered False 22:30:59.472188 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 22:31:00.623553 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:31:00.635813 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:31:00.706985 tst mo_mt_call_osmux.py: using LAC 17191 22:31:00.835055 tst mo_mt_call_osmux.py: using RAC 106 22:31:00.991408 tst mo_mt_call_osmux.py: using CellId 17191 22:31:01.122091 tst mo_mt_call_osmux.py: using BVCI 17192 22:31:01.262364 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:31:01.274922 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:31:01.287392 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:31:01.299958 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:31:01.312535 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:31:01.325398 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:31:01.467437 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:31:01.620528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:31:02.184368 run create_hlr_db(pid=22052): Launched 22:31:02.343247 bus /sierra_2: Setting Powered False 22:31:03.403806 run create_hlr_db(pid=22052): Terminated: ok {rc=0} 22:31:03.844531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22054): Launched 22:31:04.165378 run osmo-hlr_10.42.42.2(pid=22055): Launched 22:31:04.288098 run osmo-stp_10.42.42.5: Starting osmo-stp 22:31:04.843091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22057): Launched 22:31:05.164853 run osmo-stp_10.42.42.5(pid=22058): Launched 22:31:05.287534 run osmo-msc_10.42.42.6: Starting osmo-msc 22:31:05.871391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22060): Launched 22:31:06.194419 run osmo-msc_10.42.42.6(pid=22061): Launched 22:31:06.374971 run osmo-stp_10.42.42.5(pid=22058): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22058)] 22:31:06.511879 run osmo-stp_10.42.42.5(pid=22058): stdout: | (launched: 2022-12-08_22:31:05.106577) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:06.649483 run osmo-stp_10.42.42.5(pid=22058): stderr: | 20221208223105296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223105296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223105297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223105297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223105298 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223105298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223105298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:06.786334 run osmo-stp_10.42.42.5(pid=22058): stdout: | (launched: 2022-12-08_22:31:05.106577) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:06.915473 run osmo-stp_10.42.42.5(pid=22058): stderr: | 20221208223105296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223105296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223105297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223105297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223105298 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223105298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223105298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:07.069650 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22058): Process ended prematurely: osmo-stp_10.42.42.5(pid=22058) [trial-2350↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22058)] [trial-2350↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 22:31:07.079513 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 22:31:07.107988 run osmo-hlr_10.42.42.2(pid=22055): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22055)] 22:31:07.159224 run osmo-hlr_10.42.42.2(pid=22055): stdout: | (launched: 2022-12-08_22:31:04.107297) 22:31:07.212378 run osmo-hlr_10.42.42.2(pid=22055): stderr: | 20221208223104304 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223104304 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223104304 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223104304 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223104304 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223104304 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223104316 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223104324 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223104324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223104324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:31:07.286229 run osmo-msc_10.42.42.6(pid=22061): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22061)] 22:31:07.337692 run osmo-msc_10.42.42.6(pid=22061): stdout: | (launched: 2022-12-08_22:31:06.135957) 22:31:07.390524 run osmo-msc_10.42.42.6(pid=22061): stderr: | 20221208223106457 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223106457 DLGLOBAL DEBUG validating counter group 0x7f5a23b64c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223106457 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223106457 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223106457 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223106458 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223106459 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223106460 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223106460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223106460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:31:07.443531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22054): Terminating (SIGTERM) 22:31:07.485801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22057): Terminating (SIGTERM) 22:31:07.528169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22060): Terminating (SIGTERM) 22:31:07.571082 --- ParallelTerminationStrategy: PID 22054 died... 22:31:07.591480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22054): Terminated: ok {rc=0} 22:31:07.638917 --- ParallelTerminationStrategy: PID 22057 died... 22:31:07.658833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22057): Terminated: ok {rc=0} 22:31:07.705796 --- ParallelTerminationStrategy: PID 22060 died... 22:31:07.725776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22060): Terminated: ok {rc=0} 22:31:07.814384 bus /sierra_3: Setting Powered False 22:31:08.915573 bus /sierra_3: Setting Powered False 22:31:10.033035 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:31:11.291963 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:31:11.298900 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:31:11.332783 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:31:11.359930 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:31:11.414720 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:31:11.448447 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:31:11.474317 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:31:12.026332 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:31:12.077941 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:12.089357 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:31:12.159671 tst mo_mt_call.py: using LAC 17192 22:31:12.287620 tst mo_mt_call.py: using RAC 107 22:31:12.408553 tst mo_mt_call.py: using CellId 17192 22:31:12.528246 tst mo_mt_call.py: using BVCI 17193 22:31:12.641503 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:12.652474 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:12.663537 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:12.675262 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:12.687061 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:12.698875 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:31:12.814879 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:31:12.932587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:31:13.431877 run create_hlr_db(pid=22066): Launched 22:31:13.563920 bus /sierra_2: Setting Powered False 22:31:14.627281 run create_hlr_db(pid=22066): Terminated: ok {rc=0} 22:31:15.058410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22068): Launched 22:31:15.360430 run osmo-hlr_10.42.42.2(pid=22069): Launched 22:31:15.475236 run osmo-stp_10.42.42.5: Starting osmo-stp 22:31:16.022150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22071): Launched 22:31:16.367397 run osmo-stp_10.42.42.5(pid=22072): Launched 22:31:16.654690 run osmo-msc_10.42.42.6: Starting osmo-msc 22:31:17.279134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22074): Launched 22:31:17.583650 run osmo-msc_10.42.42.6(pid=22075): Launched 22:31:17.752136 run osmo-stp_10.42.42.5(pid=22072): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22072)] 22:31:17.881332 run osmo-stp_10.42.42.5(pid=22072): stdout: | (launched: 2022-12-08_22:31:16.305578) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:18.009889 run osmo-stp_10.42.42.5(pid=22072): stderr: | 20221208223116549 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223116549 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223116549 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223116550 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223116550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223116550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223116550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:18.136519 run osmo-stp_10.42.42.5(pid=22072): stdout: | (launched: 2022-12-08_22:31:16.305578) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:18.257708 run osmo-stp_10.42.42.5(pid=22072): stderr: | 20221208223116549 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223116549 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223116549 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223116550 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223116550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223116550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223116550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:18.402179 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22072): Process ended prematurely: osmo-stp_10.42.42.5(pid=22072) [trial-2350↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22072)] [trial-2350↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:31:18.411082 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 22:31:18.438300 run osmo-hlr_10.42.42.2(pid=22069): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22069)] 22:31:18.487357 run osmo-hlr_10.42.42.2(pid=22069): stdout: | (launched: 2022-12-08_22:31:15.305723) 22:31:18.538165 run osmo-hlr_10.42.42.2(pid=22069): stderr: | 20221208223115482 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223115482 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223115482 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223115482 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223115482 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223115482 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223115494 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223115503 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223115503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223115503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:31:18.608814 run osmo-msc_10.42.42.6(pid=22075): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22075)] 22:31:18.657641 run osmo-msc_10.42.42.6(pid=22075): stdout: | (launched: 2022-12-08_22:31:17.528617) 22:31:18.708122 run osmo-msc_10.42.42.6(pid=22075): stderr: | 20221208223117799 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223117799 DLGLOBAL DEBUG validating counter group 0x7fd03e758c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223117799 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223117799 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223117800 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223117800 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223117801 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223117802 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223117802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223117802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:31:18.759077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22068): Terminating (SIGTERM) 22:31:18.799502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22071): Terminating (SIGTERM) 22:31:18.840400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22074): Terminating (SIGTERM) 22:31:18.881206 --- ParallelTerminationStrategy: PID 22068 died... 22:31:18.900457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22068): Terminated: ok {rc=0} 22:31:18.945944 --- ParallelTerminationStrategy: PID 22071 died... 22:31:18.964790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22071): Terminated: ok {rc=0} 22:31:19.010283 --- ParallelTerminationStrategy: PID 22074 died... 22:31:19.029142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22074): Terminated: ok {rc=0} 22:31:19.116775 bus /sierra_3: Setting Powered False 22:31:20.216753 bus /sierra_3: Setting Powered False 22:31:21.330206 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:31:22.479329 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:22.491300 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:31:22.562830 tst mo_mt_call_osmux.py: using LAC 17193 22:31:22.695261 tst mo_mt_call_osmux.py: using RAC 108 22:31:22.820647 tst mo_mt_call_osmux.py: using CellId 17193 22:31:22.945634 tst mo_mt_call_osmux.py: using BVCI 17194 22:31:23.062336 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:23.073912 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:23.085169 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:23.096439 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:23.107867 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:23.119357 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:31:23.236938 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:31:23.353624 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:31:23.850438 run create_hlr_db(pid=22077): Launched 22:31:23.980224 bus /sierra_2: Setting Powered False 22:31:25.044239 run create_hlr_db(pid=22077): Terminated: ok {rc=0} 22:31:25.475143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22079): Launched 22:31:25.777437 run osmo-hlr_10.42.42.2(pid=22080): Launched 22:31:25.893823 run osmo-stp_10.42.42.5: Starting osmo-stp 22:31:26.423261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22082): Launched 22:31:26.724380 run osmo-stp_10.42.42.5(pid=22083): Launched 22:31:26.839454 run osmo-msc_10.42.42.6: Starting osmo-msc 22:31:27.384891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22085): Launched 22:31:27.688901 run osmo-msc_10.42.42.6(pid=22086): Launched 22:31:27.858680 run osmo-stp_10.42.42.5(pid=22083): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22083)] 22:31:27.987505 run osmo-stp_10.42.42.5(pid=22083): stdout: | (launched: 2022-12-08_22:31:26.669965) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:28.116296 run osmo-stp_10.42.42.5(pid=22083): stderr: | 20221208223126840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223126840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223126840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223126841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223126841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223126841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223126841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:28.242913 run osmo-stp_10.42.42.5(pid=22083): stdout: | (launched: 2022-12-08_22:31:26.669965) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:28.363588 run osmo-stp_10.42.42.5(pid=22083): stderr: | 20221208223126840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223126840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223126840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223126841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223126841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223126841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223126841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:28.507350 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22083): Process ended prematurely: osmo-stp_10.42.42.5(pid=22083) [trial-2350↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22083)] [trial-2350↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:31:28.516289 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:31:28.543792 run osmo-hlr_10.42.42.2(pid=22080): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22080)] 22:31:28.593719 run osmo-hlr_10.42.42.2(pid=22080): stdout: | (launched: 2022-12-08_22:31:25.722802) 22:31:28.644622 run osmo-hlr_10.42.42.2(pid=22080): stderr: | 20221208223125897 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223125897 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223125897 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223125897 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223125897 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223125897 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223125909 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223125918 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223125918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223125918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:31:28.715380 run osmo-msc_10.42.42.6(pid=22086): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22086)] 22:31:28.764234 run osmo-msc_10.42.42.6(pid=22086): stdout: | (launched: 2022-12-08_22:31:27.633534) 22:31:28.814763 run osmo-msc_10.42.42.6(pid=22086): stderr: | 20221208223127904 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223127904 DLGLOBAL DEBUG validating counter group 0x7f9486c23c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223127905 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223127905 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223127905 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223127905 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223127907 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223127907 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223127907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223127907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:31:28.865500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22079): Terminating (SIGTERM) 22:31:28.905787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22082): Terminating (SIGTERM) 22:31:28.946354 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22085): Terminating (SIGTERM) 22:31:28.986802 --- ParallelTerminationStrategy: PID 22079 died... 22:31:29.006075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22079): Terminated: ok {rc=0} 22:31:29.051313 --- ParallelTerminationStrategy: PID 22082 died... 22:31:29.070164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22082): Terminated: ok {rc=0} 22:31:29.115199 --- ParallelTerminationStrategy: PID 22085 died... 22:31:29.134393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22085): Terminated: ok {rc=0} 22:31:29.220891 bus /sierra_3: Setting Powered False 22:31:30.317681 bus /sierra_3: Setting Powered False 22:31:31.438654 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:31:32.687870 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:31:32.694261 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:31:32.727027 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:31:32.753384 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:31:32.802151 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:31:32.834705 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:31:32.860886 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:31:33.413572 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:31:33.462182 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:33.473275 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:31:33.540539 tst mo_mt_call.py: using LAC 17194 22:31:33.657168 tst mo_mt_call.py: using RAC 109 22:31:33.773351 tst mo_mt_call.py: using CellId 17194 22:31:33.892595 tst mo_mt_call.py: using BVCI 17195 22:31:34.004010 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:34.015011 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:34.025856 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:34.036893 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:34.048007 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:34.059117 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:31:34.174947 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:31:34.289584 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:31:34.754362 run create_hlr_db(pid=22092): Launched 22:31:34.869474 bus /sierra_2: Setting Powered False 22:31:35.929219 run create_hlr_db(pid=22092): Terminated: ok {rc=0} 22:31:36.370833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22094): Launched 22:31:36.693452 run osmo-hlr_10.42.42.2(pid=22095): Launched 22:31:36.816587 run osmo-stp_10.42.42.5: Starting osmo-stp 22:31:37.378107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22097): Launched 22:31:37.700035 run osmo-stp_10.42.42.5(pid=22098): Launched 22:31:37.822788 run osmo-msc_10.42.42.6: Starting osmo-msc 22:31:38.411675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22100): Launched 22:31:38.733695 run osmo-msc_10.42.42.6(pid=22101): Launched 22:31:38.913343 run osmo-stp_10.42.42.5(pid=22098): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22098)] 22:31:39.051151 run osmo-stp_10.42.42.5(pid=22098): stdout: | (launched: 2022-12-08_22:31:37.641901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:39.188755 run osmo-stp_10.42.42.5(pid=22098): stderr: | 20221208223137833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223137833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223137834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223137834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223137834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223137834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223137835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:39.325394 run osmo-stp_10.42.42.5(pid=22098): stdout: | (launched: 2022-12-08_22:31:37.641901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:39.454962 run osmo-stp_10.42.42.5(pid=22098): stderr: | 20221208223137833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223137833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223137834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223137834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223137834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223137834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223137835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:39.609424 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22098): Process ended prematurely: osmo-stp_10.42.42.5(pid=22098) [trial-2350↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22098)] [trial-2350↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:31:39.619150 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:31:39.647398 run osmo-hlr_10.42.42.2(pid=22095): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22095)] 22:31:39.698404 run osmo-hlr_10.42.42.2(pid=22095): stdout: | (launched: 2022-12-08_22:31:36.635486) 22:31:39.751223 run osmo-hlr_10.42.42.2(pid=22095): stderr: | 20221208223136834 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223136834 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223136834 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223136834 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223136834 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223136834 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223136846 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223136854 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223136854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223136854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:31:39.825090 run osmo-msc_10.42.42.6(pid=22101): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22101)] 22:31:39.876146 run osmo-msc_10.42.42.6(pid=22101): stdout: | (launched: 2022-12-08_22:31:38.675567) 22:31:39.929072 run osmo-msc_10.42.42.6(pid=22101): stderr: | 20221208223138998 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223138998 DLGLOBAL DEBUG validating counter group 0x7fdce4308c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223138998 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223138998 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223138998 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223138999 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223139000 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223139001 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223139001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223139001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:31:39.982298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22094): Terminating (SIGTERM) 22:31:40.024655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22097): Terminating (SIGTERM) 22:31:40.066992 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22100): Terminating (SIGTERM) 22:31:40.109827 --- ParallelTerminationStrategy: PID 22094 died... 22:31:40.129972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22094): Terminated: ok {rc=0} 22:31:40.177266 --- ParallelTerminationStrategy: PID 22097 died... 22:31:40.197153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22097): Terminated: ok {rc=0} 22:31:40.244002 --- ParallelTerminationStrategy: PID 22100 died... 22:31:40.263935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22100): Terminated: ok {rc=0} 22:31:40.352102 bus /sierra_3: Setting Powered False 22:31:41.452369 bus /sierra_3: Setting Powered False 22:31:42.569391 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:31:43.718444 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:43.730751 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:31:43.808763 tst mo_mt_call_osmux.py: using LAC 17195 22:31:43.936548 tst mo_mt_call_osmux.py: using RAC 110 22:31:44.061766 tst mo_mt_call_osmux.py: using CellId 17195 22:31:44.182241 tst mo_mt_call_osmux.py: using BVCI 17196 22:31:44.294367 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:44.305765 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:44.316633 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:44.327746 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:44.338915 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:44.350196 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:31:44.468075 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:31:44.587215 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:31:45.087348 run create_hlr_db(pid=22103): Launched 22:31:45.218459 bus /sierra_2: Setting Powered False 22:31:46.292264 run create_hlr_db(pid=22103): Terminated: ok {rc=0} 22:31:46.811190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22105): Launched 22:31:47.149139 run osmo-hlr_10.42.42.2(pid=22106): Launched 22:31:47.308806 run osmo-stp_10.42.42.5: Starting osmo-stp 22:31:47.841180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22108): Launched 22:31:48.143855 run osmo-stp_10.42.42.5(pid=22109): Launched 22:31:48.259037 run osmo-msc_10.42.42.6: Starting osmo-msc 22:31:48.810946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22111): Launched 22:31:49.119589 run osmo-msc_10.42.42.6(pid=22112): Launched 22:31:49.299461 run osmo-stp_10.42.42.5(pid=22109): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22109)] 22:31:49.438631 run osmo-stp_10.42.42.5(pid=22109): stdout: | (launched: 2022-12-08_22:31:48.088817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:49.576195 run osmo-stp_10.42.42.5(pid=22109): stderr: | 20221208223148256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223148256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223148256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223148257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223148259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223148259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223148259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:49.712467 run osmo-stp_10.42.42.5(pid=22109): stdout: | (launched: 2022-12-08_22:31:48.088817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:49.841768 run osmo-stp_10.42.42.5(pid=22109): stderr: | 20221208223148256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223148256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223148256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223148257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223148259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223148259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223148259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:49.996386 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22109): Process ended prematurely: osmo-stp_10.42.42.5(pid=22109) [trial-2350↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22109)] [trial-2350↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:31:50.006114 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:31:50.034491 run osmo-hlr_10.42.42.2(pid=22106): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22106)] 22:31:50.085279 run osmo-hlr_10.42.42.2(pid=22106): stdout: | (launched: 2022-12-08_22:31:47.088304) 22:31:50.137596 run osmo-hlr_10.42.42.2(pid=22106): stderr: | 20221208223147308 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223147308 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223147308 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223147308 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223147308 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223147308 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223147320 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223147329 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223147329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223147329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:31:50.210838 run osmo-msc_10.42.42.6(pid=22112): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22112)] 22:31:50.261334 run osmo-msc_10.42.42.6(pid=22112): stdout: | (launched: 2022-12-08_22:31:49.058972) 22:31:50.313533 run osmo-msc_10.42.42.6(pid=22112): stderr: | 20221208223149379 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223149379 DLGLOBAL DEBUG validating counter group 0x7fa49eb79c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223149379 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223149379 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223149379 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223149379 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223149381 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223149382 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223149382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223149382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:31:50.366340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22105): Terminating (SIGTERM) 22:31:50.408720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22108): Terminating (SIGTERM) 22:31:50.451032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22111): Terminating (SIGTERM) 22:31:50.493710 --- ParallelTerminationStrategy: PID 22105 died... 22:31:50.513895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22105): Terminated: ok {rc=0} 22:31:50.561106 --- ParallelTerminationStrategy: PID 22108 died... 22:31:50.581012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22108): Terminated: ok {rc=0} 22:31:50.627544 --- ParallelTerminationStrategy: PID 22111 died... 22:31:50.647502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22111): Terminated: ok {rc=0} 22:31:50.735786 bus /sierra_3: Setting Powered False 22:31:51.836858 bus /sierra_3: Setting Powered False 22:31:52.954119 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:31:54.207568 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:31:54.213747 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:31:54.247286 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 22:31:54.274439 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 22:31:54.327887 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:31:54.361716 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 22:31:54.388576 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 22:31:54.936917 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 22:31:54.988330 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:31:54.999596 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:31:55.070228 tst mo_mt_call.py: using LAC 17196 22:31:55.198469 tst mo_mt_call.py: using RAC 111 22:31:55.327046 tst mo_mt_call.py: using CellId 17196 22:31:55.455014 tst mo_mt_call.py: using BVCI 17197 22:31:55.573996 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:31:55.585218 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:31:55.596156 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:31:55.607166 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:31:55.618165 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:31:55.629250 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:31:55.745299 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:31:55.859544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:31:56.328596 run create_hlr_db(pid=22117): Launched 22:31:56.445176 bus /sierra_2: Setting Powered False 22:31:57.506355 run create_hlr_db(pid=22117): Terminated: ok {rc=0} 22:31:57.927632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22119): Launched 22:31:58.229890 run osmo-hlr_10.42.42.2(pid=22120): Launched 22:31:58.345132 run osmo-stp_10.42.42.5: Starting osmo-stp 22:31:58.881228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22122): Launched 22:31:59.183176 run osmo-stp_10.42.42.5(pid=22123): Launched 22:31:59.298706 run osmo-msc_10.42.42.6: Starting osmo-msc 22:31:59.845605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22125): Launched 22:32:00.149724 run osmo-msc_10.42.42.6(pid=22126): Launched 22:32:00.318353 run osmo-stp_10.42.42.5(pid=22123): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22123)] 22:32:00.447553 run osmo-stp_10.42.42.5(pid=22123): stdout: | (launched: 2022-12-08_22:31:59.128062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:00.577444 run osmo-stp_10.42.42.5(pid=22123): stderr: | 20221208223159297 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223159297 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223159297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223159298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223159300 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223159300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223159300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:00.704167 run osmo-stp_10.42.42.5(pid=22123): stdout: | (launched: 2022-12-08_22:31:59.128062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:00.825481 run osmo-stp_10.42.42.5(pid=22123): stderr: | 20221208223159297 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223159297 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223159297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223159298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223159300 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223159300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223159300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:01.007785 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22123): Process ended prematurely: osmo-stp_10.42.42.5(pid=22123) [trial-2350↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22123)] [trial-2350↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 22:32:01.017753 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:32:01.046834 run osmo-hlr_10.42.42.2(pid=22120): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22120)] 22:32:01.097393 run osmo-hlr_10.42.42.2(pid=22120): stdout: | (launched: 2022-12-08_22:31:58.174746) 22:32:01.149627 run osmo-hlr_10.42.42.2(pid=22120): stderr: | 20221208223158352 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223158352 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223158352 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223158352 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223158352 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223158352 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223158364 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223158373 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223158373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223158373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:32:01.222725 run osmo-msc_10.42.42.6(pid=22126): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22126)] 22:32:01.273095 run osmo-msc_10.42.42.6(pid=22126): stdout: | (launched: 2022-12-08_22:32:00.094235) 22:32:01.325485 run osmo-msc_10.42.42.6(pid=22126): stderr: | 20221208223200365 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223200365 DLGLOBAL DEBUG validating counter group 0x7fa64c38dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223200365 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223200365 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223200365 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223200365 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223200367 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223200367 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223200368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223200368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:32:01.378836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22119): Terminating (SIGTERM) 22:32:01.421311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22122): Terminating (SIGTERM) 22:32:01.464128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22125): Terminating (SIGTERM) 22:32:01.507107 --- ParallelTerminationStrategy: PID 22119 died... 22:32:01.527098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22119): Terminated: ok {rc=0} 22:32:01.575540 --- ParallelTerminationStrategy: PID 22122 died... 22:32:01.595496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22122): Terminated: ok {rc=0} 22:32:01.643498 --- ParallelTerminationStrategy: PID 22125 died... 22:32:01.663311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22125): Terminated: ok {rc=0} 22:32:01.764050 bus /sierra_3: Setting Powered False 22:32:02.862937 bus /sierra_3: Setting Powered False 22:32:03.979830 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 22:32:05.127707 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:32:05.139194 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:32:05.209844 tst mo_mt_call_osmux.py: using LAC 17197 22:32:05.336884 tst mo_mt_call_osmux.py: using RAC 112 22:32:05.465659 tst mo_mt_call_osmux.py: using CellId 17197 22:32:05.592666 tst mo_mt_call_osmux.py: using BVCI 17198 22:32:05.709781 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:32:05.720912 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:32:05.732019 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:32:05.743076 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:32:05.754242 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:32:05.765368 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:32:05.883520 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:32:05.997184 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:32:06.465197 run create_hlr_db(pid=22128): Launched 22:32:06.581980 bus /sierra_2: Setting Powered False 22:32:07.641983 run create_hlr_db(pid=22128): Terminated: ok {rc=0} 22:32:08.083131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22130): Launched 22:32:08.406300 run osmo-hlr_10.42.42.2(pid=22131): Launched 22:32:08.528909 run osmo-stp_10.42.42.5: Starting osmo-stp 22:32:09.061528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22133): Launched 22:32:09.364172 run osmo-stp_10.42.42.5(pid=22134): Launched 22:32:09.491120 run osmo-msc_10.42.42.6: Starting osmo-msc 22:32:10.076427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22136): Launched 22:32:10.400675 run osmo-msc_10.42.42.6(pid=22137): Launched 22:32:10.581170 run osmo-stp_10.42.42.5(pid=22134): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22134)] 22:32:10.717316 run osmo-stp_10.42.42.5(pid=22134): stdout: | (launched: 2022-12-08_22:32:09.308940) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:10.854024 run osmo-stp_10.42.42.5(pid=22134): stderr: | 20221208223209491 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223209491 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223209491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223209492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223209494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223209494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223209494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:10.990082 run osmo-stp_10.42.42.5(pid=22134): stdout: | (launched: 2022-12-08_22:32:09.308940) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:11.119144 run osmo-stp_10.42.42.5(pid=22134): stderr: | 20221208223209491 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223209491 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223209491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223209492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223209494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223209494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223209494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:11.273921 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22134): Process ended prematurely: osmo-stp_10.42.42.5(pid=22134) [trial-2350↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22134)] [trial-2350↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 22:32:11.283538 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:32:11.312242 run osmo-hlr_10.42.42.2(pid=22131): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22131)] 22:32:11.364717 run osmo-hlr_10.42.42.2(pid=22131): stdout: | (launched: 2022-12-08_22:32:08.347903) 22:32:11.418011 run osmo-hlr_10.42.42.2(pid=22131): stderr: | 20221208223208546 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223208546 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223208546 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223208547 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223208547 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223208547 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223208559 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223208567 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223208567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223208568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:32:11.491894 run osmo-msc_10.42.42.6(pid=22137): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22137)] 22:32:11.543549 run osmo-msc_10.42.42.6(pid=22137): stdout: | (launched: 2022-12-08_22:32:10.341731) 22:32:11.597305 run osmo-msc_10.42.42.6(pid=22137): stderr: | 20221208223210664 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223210665 DLGLOBAL DEBUG validating counter group 0x7f0e927c1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223210665 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223210665 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223210665 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223210665 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223210667 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223210667 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223210667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223210667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:32:11.650858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22130): Terminating (SIGTERM) 22:32:11.693818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22133): Terminating (SIGTERM) 22:32:11.736864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22136): Terminating (SIGTERM) 22:32:11.780422 --- ParallelTerminationStrategy: PID 22130 died... 22:32:11.800778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22130): Terminated: ok {rc=0} 22:32:11.849212 --- ParallelTerminationStrategy: PID 22133 died... 22:32:11.869097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22133): Terminated: ok {rc=0} 22:32:11.917515 --- ParallelTerminationStrategy: PID 22136 died... 22:32:11.937626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22136): Terminated: ok {rc=0} 22:32:12.028054 bus /sierra_3: Setting Powered False 22:32:13.129257 bus /sierra_3: Setting Powered False 22:32:14.244053 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 emergency:trx-lms --------------------------------------------------------------------- 22:32:15.492471 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:32:15.496773 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 22:32:15.530263 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 22:32:15.556353 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 22:32:15.639478 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 22:32:15.671953 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 22:32:15.698813 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 22:32:16.320162 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2350 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 22:32:16.327720 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:16.340182 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 22:32:16.395293 tst emergency_mo_mt_call.py: using LAC 17198 22:32:16.514442 tst emergency_mo_mt_call.py: using RAC 113 22:32:16.642453 tst emergency_mo_mt_call.py: using CellId 17198 22:32:16.763799 tst emergency_mo_mt_call.py: using BVCI 17199 22:32:16.882594 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:16.894339 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:16.906256 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:16.918350 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:16.930001 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:16.942028 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 22:32:17.061051 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 22:32:17.178771 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:32:17.673697 run create_hlr_db(pid=22143): Launched 22:32:17.803319 bus /sierra_2: Setting Powered False 22:32:18.865744 run create_hlr_db(pid=22143): Terminated: ok {rc=0} 22:32:19.306472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22145): Launched 22:32:19.622744 run osmo-hlr_10.42.42.2(pid=22146): Launched 22:32:19.742235 run osmo-stp_10.42.42.5: Starting osmo-stp 22:32:20.286689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22148): Launched 22:32:20.602509 run osmo-stp_10.42.42.5(pid=22149): Launched 22:32:20.732282 tst emergency_mo_mt_call.py: using MSISDN 6882 22:32:20.893808 run osmo-msc_10.42.42.6: Starting osmo-msc 22:32:21.463555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22151): Launched 22:32:21.779949 run osmo-msc_10.42.42.6(pid=22152): Launched 22:32:21.955865 run osmo-stp_10.42.42.5(pid=22149): ERR: Terminated: ERROR {rc=1} [trial-2350↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22149)] 22:32:22.089823 run osmo-stp_10.42.42.5(pid=22149): stdout: | (launched: 2022-12-08_22:32:20.545113) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:22.223786 run osmo-stp_10.42.42.5(pid=22149): stderr: | 20221208223220735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223220735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223220735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223220736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223220736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223220736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223220736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:22.357932 run osmo-stp_10.42.42.5(pid=22149): stdout: | (launched: 2022-12-08_22:32:20.545113) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:22.483872 run osmo-stp_10.42.42.5(pid=22149): stderr: | 20221208223220735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223220735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223220735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223220736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223220736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223220736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223220736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:22.634417 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=22149): Process ended prematurely: osmo-stp_10.42.42.5(pid=22149) [trial-2350↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22149)] [trial-2350↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 22:32:22.643307 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 22:32:22.672567 run osmo-hlr_10.42.42.2(pid=22146): ERR: Terminated: ERROR {rc=237} [trial-2350↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22146)] 22:32:22.721784 run osmo-hlr_10.42.42.2(pid=22146): stdout: | (launched: 2022-12-08_22:32:19.565797) 22:32:22.772653 run osmo-hlr_10.42.42.2(pid=22146): stderr: | 20221208223219763 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223219763 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223219763 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223219763 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223219763 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223219763 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223219776 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223219785 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223219785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223219785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:32:22.843169 run osmo-msc_10.42.42.6(pid=22152): ERR: Terminated: ERROR {rc=2} [trial-2350↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22152)] 22:32:22.892468 run osmo-msc_10.42.42.6(pid=22152): stdout: | (launched: 2022-12-08_22:32:21.722377) 22:32:22.943251 run osmo-msc_10.42.42.6(pid=22152): stderr: | 20221208223222043 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223222043 DLGLOBAL DEBUG validating counter group 0x7f8437272c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223222043 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223222043 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223222044 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223222044 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223222047 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223222048 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223222048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223222048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:32:22.994371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22145): Terminating (SIGTERM) 22:32:23.035339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22148): Terminating (SIGTERM) 22:32:23.076332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22151): Terminating (SIGTERM) 22:32:23.117977 --- ParallelTerminationStrategy: PID 22145 died... 22:32:23.136688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22145): Terminated: ok {rc=0} 22:32:23.182828 --- ParallelTerminationStrategy: PID 22148 died... 22:32:23.201518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22148): Terminated: ok {rc=0} 22:32:23.247280 --- ParallelTerminationStrategy: PID 22151 died... 22:32:23.266245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22151): Terminated: ok {rc=0} 22:32:23.354274 bus /sierra_3: Setting Powered False 22:32:24.455604 bus /sierra_3: Setting Powered False 22:32:25.572514 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 22:32:26.660286 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:26.671699 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 22:32:26.724633 tst emergency_preemptive_call.py: using LAC 17199 22:32:26.842710 tst emergency_preemptive_call.py: using RAC 114 22:32:26.959521 tst emergency_preemptive_call.py: using CellId 17199 22:32:27.074749 tst emergency_preemptive_call.py: using BVCI 17200 22:32:27.183517 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:27.194258 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:27.204713 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:27.215525 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:27.226301 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:27.237071 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 22:32:27.349504 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 22:32:27.466604 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 22:32:27.581344 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 22:32:27.694411 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:32:28.154784 run create_hlr_db(pid=22154): Launched 22:32:28.268063 bus /sierra_2: Setting Powered False 22:32:29.328313 run create_hlr_db(pid=22154): Terminated: ok {rc=0} 22:32:29.764109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22156): Launched 22:32:30.081082 run osmo-hlr_10.42.42.2(pid=22157): Launched 22:32:30.202182 run osmo-stp_10.42.42.5: Starting osmo-stp 22:32:30.754708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22159): Launched 22:32:31.075748 run osmo-stp_10.42.42.5(pid=22160): Launched 22:32:31.311179 tst emergency_preemptive_call.py: using MSISDN 6883 22:32:31.575678 run osmo-msc_10.42.42.6: Starting osmo-msc 22:32:32.136901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22162): Launched 22:32:32.458804 run osmo-msc_10.42.42.6(pid=22163): Launched 22:32:32.633166 run osmo-stp_10.42.42.5(pid=22160): ERR: Terminated: ERROR {rc=1} [trial-2350↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22160)] 22:32:32.766405 run osmo-stp_10.42.42.5(pid=22160): stdout: | (launched: 2022-12-08_22:32:31.016322) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:32.899799 run osmo-stp_10.42.42.5(pid=22160): stderr: | 20221208223231298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223231298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223231300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223231300 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223231301 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223231302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223231302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:33.033345 run osmo-stp_10.42.42.5(pid=22160): stdout: | (launched: 2022-12-08_22:32:31.016322) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:33.159575 run osmo-stp_10.42.42.5(pid=22160): stderr: | 20221208223231298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223231298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223231300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223231300 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223231301 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223231302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223231302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:33.310125 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=22160): Process ended prematurely: osmo-stp_10.42.42.5(pid=22160) [trial-2350↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22160)] [trial-2350↪emergency:trx-lms↪emergency_preemptive_call.py:32] 22:32:33.319208 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 22:32:33.347245 run osmo-hlr_10.42.42.2(pid=22157): ERR: Terminated: ERROR {rc=237} [trial-2350↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22157)] 22:32:33.398939 run osmo-hlr_10.42.42.2(pid=22157): stdout: | (launched: 2022-12-08_22:32:30.023652) 22:32:33.452415 run osmo-hlr_10.42.42.2(pid=22157): stderr: | 20221208223230220 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223230221 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223230221 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223230221 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223230221 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223230221 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223230233 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223230241 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223230241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223230241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:32:33.526512 run osmo-msc_10.42.42.6(pid=22163): ERR: Terminated: ERROR {rc=2} [trial-2350↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22163)] 22:32:33.577550 run osmo-msc_10.42.42.6(pid=22163): stdout: | (launched: 2022-12-08_22:32:32.401582) 22:32:33.630368 run osmo-msc_10.42.42.6(pid=22163): stderr: | 20221208223232723 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223232723 DLGLOBAL DEBUG validating counter group 0x7f50f9e62c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223232723 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223232723 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223232724 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223232724 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223232726 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223232726 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223232726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223232726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:32:33.683453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22156): Terminating (SIGTERM) 22:32:33.725889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22159): Terminating (SIGTERM) 22:32:33.768348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22162): Terminating (SIGTERM) 22:32:33.811138 --- ParallelTerminationStrategy: PID 22156 died... 22:32:33.831470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22156): Terminated: ok {rc=0} 22:32:33.878760 --- ParallelTerminationStrategy: PID 22159 died... 22:32:33.898802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22159): Terminated: ok {rc=0} 22:32:33.945983 --- ParallelTerminationStrategy: PID 22162 died... 22:32:33.966009 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22162): Terminated: ok {rc=0} 22:32:34.055282 bus /sierra_9: Setting Powered False 22:32:35.156083 bus /sierra_9: Setting Powered False 22:32:36.273609 bus /sierra_8: Setting Powered False 22:32:37.373338 bus /sierra_8: Setting Powered False 22:32:38.490915 bus /sierra_3: Setting Powered False 22:32:39.590454 bus /sierra_3: Setting Powered False 22:32:40.708375 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:trx-lms --------------------------------------------------------------------- 22:32:41.987433 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:32:41.991955 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 22:32:42.025376 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 22:32:42.064577 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 22:32:42.154816 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 22:32:42.187625 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 22:32:42.225702 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 22:32:42.816324 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 22:32:42.868732 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:42.879828 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 22:32:42.929644 tst cs_paging_gprs_active.py: using LAC 17200 22:32:43.058035 tst cs_paging_gprs_active.py: using RAC 115 22:32:43.185510 tst cs_paging_gprs_active.py: using CellId 17200 22:32:43.311081 tst cs_paging_gprs_active.py: using BVCI 17201 22:32:43.428762 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:43.439815 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:43.450516 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:43.461255 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:43.471995 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:43.482741 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:43.493585 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:43.504379 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:43.515366 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:32:43.631029 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:32:43.745084 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:32:43.946924 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:32:44.249592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22168): Launched 22:32:44.514685 run iperf3-srv_10.42.42.10(pid=22169): Launched 22:32:44.628713 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:32:44.830381 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:32:45.133483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22170): Launched 22:32:45.398981 run iperf3-srv_10.42.42.10(pid=22171): Launched 22:32:45.513208 tst cs_paging_gprs_active.py:38: start network... 22:32:45.716238 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:32:46.245701 run create_hlr_db(pid=22172): Launched 22:32:46.369928 bus /sierra_2: Setting Powered False 22:32:47.431626 run create_hlr_db(pid=22172): Terminated: ok {rc=0} 22:32:47.874915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22174): Launched 22:32:48.197774 run osmo-hlr_10.42.42.2(pid=22175): Launched 22:32:48.320289 run osmo-stp_10.42.42.5: Starting osmo-stp 22:32:48.874952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22177): Launched 22:32:49.178751 run osmo-stp_10.42.42.5(pid=22178): Launched 22:32:49.294170 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:32:49.816933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22180): Launched 22:32:49.934200 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:32:50.193746 run patchelf(pid=22181): Launched 22:32:50.374632 run osmo-stp_10.42.42.5(pid=22178): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22178)] 22:32:50.511550 run osmo-stp_10.42.42.5(pid=22178): stdout: | (launched: 2022-12-08_22:32:49.123732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:50.649762 run osmo-stp_10.42.42.5(pid=22178): stderr: | 20221208223249293 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223249293 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223249293 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223249294 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223249294 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223249294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223249294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:50.787931 run osmo-stp_10.42.42.5(pid=22178): stdout: | (launched: 2022-12-08_22:32:49.123732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:50.921277 run osmo-stp_10.42.42.5(pid=22178): stderr: | 20221208223249293 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223249293 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223249293 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223249294 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223249294 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223249294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223249294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:51.078966 run patchelf(pid=22181): Terminating (SIGINT) 22:32:51.259976 run patchelf(pid=22181): Terminated: ok {rc=0} 22:32:51.391083 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22178): Process ended prematurely: osmo-stp_10.42.42.5(pid=22178) [trial-2350↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22178)] [trial-2350↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 22:32:51.401381 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 22:32:51.430476 run osmo-hlr_10.42.42.2(pid=22175): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22175)] 22:32:51.481644 run osmo-hlr_10.42.42.2(pid=22175): stdout: | (launched: 2022-12-08_22:32:48.139526) 22:32:51.534633 run osmo-hlr_10.42.42.2(pid=22175): stderr: | 20221208223248337 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223248338 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223248338 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223248338 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223248338 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223248338 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223248350 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223248358 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223248358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223248358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:32:51.588586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22168): Terminating (SIGTERM) 22:32:51.631554 run iperf3-srv_10.42.42.10(pid=22169): Terminating (SIGTERM) 22:32:51.674518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22170): Terminating (SIGTERM) 22:32:51.717483 run iperf3-srv_10.42.42.10(pid=22171): Terminating (SIGTERM) 22:32:51.760054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22174): Terminating (SIGTERM) 22:32:51.802688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22177): Terminating (SIGTERM) 22:32:51.845316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22180): Terminating (SIGTERM) 22:32:51.888152 --- ParallelTerminationStrategy: PID 22168 died... 22:32:51.908521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22168): Terminated: ok {rc=0} 22:32:51.955931 --- ParallelTerminationStrategy: PID 22169 died... 22:32:51.975766 run iperf3-srv_10.42.42.10(pid=22169): Terminated {rc=256} 22:32:52.022790 --- ParallelTerminationStrategy: PID 22170 died... 22:32:52.042883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22170): Terminated: ok {rc=0} 22:32:52.089802 --- ParallelTerminationStrategy: PID 22171 died... 22:32:52.109743 run iperf3-srv_10.42.42.10(pid=22171): Terminated {rc=256} 22:32:52.156560 --- ParallelTerminationStrategy: PID 22174 died... 22:32:52.176544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22174): Terminated: ok {rc=0} 22:32:52.223649 --- ParallelTerminationStrategy: PID 22177 died... 22:32:52.243728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22177): Terminated: ok {rc=0} 22:32:52.291366 --- ParallelTerminationStrategy: PID 22180 died... 22:32:52.311434 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22180): Terminated: ok {rc=0} 22:32:52.401573 bus /gobi_0: Setting Powered False 22:32:53.503053 bus /gobi_0: Setting Powered False 22:32:54.620661 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms iperf3.py ---------------------------------------------- 22:32:55.765686 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:55.776740 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 22:32:55.827408 tst iperf3.py: using LAC 17201 22:32:55.947052 tst iperf3.py: using RAC 116 22:32:56.073858 tst iperf3.py: using CellId 17201 22:32:56.200180 tst iperf3.py: using BVCI 17202 22:32:56.319082 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:56.330384 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:56.341538 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:56.352434 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:56.363376 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:56.374758 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:56.385881 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:56.396789 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:56.407751 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:32:56.521365 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:32:56.724040 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:32:57.026928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22182): Launched 22:32:57.290088 run iperf3-srv_10.42.42.10(pid=22183): Launched 22:32:57.404018 tst iperf3.py:8: start network... 22:32:57.606500 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:32:58.076733 run create_hlr_db(pid=22184): Launched 22:32:58.193761 bus /gobi_6: Setting Powered False 22:32:59.254478 run create_hlr_db(pid=22184): Terminated: ok {rc=0} 22:32:59.697539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22186): Launched 22:33:00.021984 run osmo-hlr_10.42.42.2(pid=22187): Launched 22:33:00.145620 run osmo-stp_10.42.42.5: Starting osmo-stp 22:33:00.700743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22189): Launched 22:33:01.045385 run osmo-stp_10.42.42.5(pid=22190): Launched 22:33:01.275173 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:33:01.972581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22193): Launched 22:33:02.107438 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:33:02.381777 run patchelf(pid=22194): Launched 22:33:02.562615 run osmo-stp_10.42.42.5(pid=22190): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22190)] 22:33:02.700461 run osmo-stp_10.42.42.5(pid=22190): stdout: | (launched: 2022-12-08_22:33:00.986509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:02.840059 run osmo-stp_10.42.42.5(pid=22190): stderr: | 20221208223301297 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223301298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223301298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223301298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223301299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223301299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223301299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:02.979588 run osmo-stp_10.42.42.5(pid=22190): stdout: | (launched: 2022-12-08_22:33:00.986509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:03.113710 run osmo-stp_10.42.42.5(pid=22190): stderr: | 20221208223301297 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223301298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223301298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223301298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223301299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223301299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223301299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:03.272516 run patchelf(pid=22194): Terminating (SIGINT) 22:33:03.455619 run patchelf(pid=22194): Terminated: ok {rc=0} 22:33:03.587224 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22190): Process ended prematurely: osmo-stp_10.42.42.5(pid=22190) [trial-2350↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22190)] [trial-2350↪gprs:trx-lms↪iperf3.py:8] 22:33:03.597390 tst iperf3.py:8: Test FAILED (7.9 sec) 22:33:03.626105 run osmo-hlr_10.42.42.2(pid=22187): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22187)] 22:33:03.677727 run osmo-hlr_10.42.42.2(pid=22187): stdout: | (launched: 2022-12-08_22:32:59.963372) 22:33:03.730807 run osmo-hlr_10.42.42.2(pid=22187): stderr: | 20221208223300161 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223300161 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223300161 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223300161 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223300161 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223300162 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223300174 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223300182 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223300182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223300182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:33:03.784006 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22182): Terminating (SIGTERM) 22:33:03.826630 run iperf3-srv_10.42.42.10(pid=22183): Terminating (SIGTERM) 22:33:03.869003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22186): Terminating (SIGTERM) 22:33:03.911493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22189): Terminating (SIGTERM) 22:33:03.953983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22193): Terminating (SIGTERM) 22:33:03.996655 --- ParallelTerminationStrategy: PID 22182 died... 22:33:04.017053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22182): Terminated: ok {rc=0} 22:33:04.064109 --- ParallelTerminationStrategy: PID 22183 died... 22:33:04.083953 run iperf3-srv_10.42.42.10(pid=22183): Terminated {rc=256} 22:33:04.130572 --- ParallelTerminationStrategy: PID 22186 died... 22:33:04.150398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22186): Terminated: ok {rc=0} 22:33:04.197163 --- ParallelTerminationStrategy: PID 22189 died... 22:33:04.216899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22189): Terminated: ok {rc=0} 22:33:04.263664 --- ParallelTerminationStrategy: PID 22193 died... 22:33:04.283589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22193): Terminated: ok {rc=0} 22:33:04.371832 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms iperf3m4.py ---------------------------------------------- 22:33:05.522212 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:05.533759 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 22:33:05.583454 tst iperf3m4.py: using LAC 17202 22:33:05.706635 tst iperf3m4.py: using RAC 117 22:33:05.829477 tst iperf3m4.py: using CellId 17202 22:33:05.948829 tst iperf3m4.py: using BVCI 17203 22:33:06.059921 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:06.070984 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:06.081848 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:06.093691 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:06.104757 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:06.116092 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:06.127468 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:06.138766 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:06.150248 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:33:06.269955 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:33:06.392149 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:33:06.511125 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:33:06.628582 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:33:06.831274 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:33:07.134353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22195): Launched 22:33:07.396836 run iperf3-srv_10.42.42.10(pid=22196): Launched 22:33:07.510276 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:33:07.712614 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:33:08.015937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22197): Launched 22:33:08.279488 run iperf3-srv_10.42.42.10(pid=22198): Launched 22:33:08.393451 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:33:08.595756 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:33:08.899815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22199): Launched 22:33:09.162498 run iperf3-srv_10.42.42.10(pid=22200): Launched 22:33:09.275848 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:33:09.477916 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:33:09.781582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22201): Launched 22:33:10.045154 run iperf3-srv_10.42.42.10(pid=22202): Launched 22:33:10.158963 tst iperf3m4.py:8: start network... 22:33:10.361559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:33:10.830849 run create_hlr_db(pid=22203): Launched 22:33:10.945906 bus /gobi_6: Setting Powered False 22:33:12.007109 run create_hlr_db(pid=22203): Terminated: ok {rc=0} 22:33:12.429988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22205): Launched 22:33:12.733218 run osmo-hlr_10.42.42.2(pid=22206): Launched 22:33:12.849046 run osmo-stp_10.42.42.5: Starting osmo-stp 22:33:13.384488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22208): Launched 22:33:13.686691 run osmo-stp_10.42.42.5(pid=22209): Launched 22:33:13.802787 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:33:14.323601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22211): Launched 22:33:14.439349 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:33:14.694619 run patchelf(pid=22212): Launched 22:33:14.863146 run osmo-stp_10.42.42.5(pid=22209): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22209)] 22:33:14.991500 run osmo-stp_10.42.42.5(pid=22209): stdout: | (launched: 2022-12-08_22:33:13.631749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:15.121251 run osmo-stp_10.42.42.5(pid=22209): stderr: | 20221208223313801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223313801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223313801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223313802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223313802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223313802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223313802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:15.251309 run osmo-stp_10.42.42.5(pid=22209): stdout: | (launched: 2022-12-08_22:33:13.631749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:15.375749 run osmo-stp_10.42.42.5(pid=22209): stderr: | 20221208223313801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223313801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223313801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223313802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223313802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223313802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223313802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:15.523290 run patchelf(pid=22212): Terminating (SIGINT) 22:33:15.693830 run patchelf(pid=22212): Terminated: ok {rc=0} 22:33:15.817341 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22209): Process ended prematurely: osmo-stp_10.42.42.5(pid=22209) [trial-2350↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22209)] [trial-2350↪gprs:trx-lms↪iperf3m4.py:8] 22:33:15.826738 tst iperf3m4.py:8: Test FAILED (10.3 sec) 22:33:15.875948 run osmo-hlr_10.42.42.2(pid=22206): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22206)] 22:33:15.926896 run osmo-hlr_10.42.42.2(pid=22206): stdout: | (launched: 2022-12-08_22:33:12.678016) 22:33:15.979633 run osmo-hlr_10.42.42.2(pid=22206): stderr: | 20221208223312855 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223312855 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223312855 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223312855 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223312855 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223312855 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223312867 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223312876 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223312877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223312877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:33:16.032626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22195): Terminating (SIGTERM) 22:33:16.075485 run iperf3-srv_10.42.42.10(pid=22196): Terminating (SIGTERM) 22:33:16.117979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22197): Terminating (SIGTERM) 22:33:16.160454 run iperf3-srv_10.42.42.10(pid=22198): Terminating (SIGTERM) 22:33:16.203065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22199): Terminating (SIGTERM) 22:33:16.246183 run iperf3-srv_10.42.42.10(pid=22200): Terminating (SIGTERM) 22:33:16.290262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22201): Terminating (SIGTERM) 22:33:16.333075 run iperf3-srv_10.42.42.10(pid=22202): Terminating (SIGTERM) 22:33:16.375337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22205): Terminating (SIGTERM) 22:33:16.417848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22208): Terminating (SIGTERM) 22:33:16.460355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22211): Terminating (SIGTERM) 22:33:16.502983 --- ParallelTerminationStrategy: PID 22195 died... 22:33:16.522717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22195): Terminated: ok {rc=0} 22:33:16.570605 --- ParallelTerminationStrategy: PID 22196 died... 22:33:16.590272 run iperf3-srv_10.42.42.10(pid=22196): Terminated {rc=256} 22:33:16.637865 --- ParallelTerminationStrategy: PID 22197 died... 22:33:16.657434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22197): Terminated: ok {rc=0} 22:33:16.705154 --- ParallelTerminationStrategy: PID 22198 died... 22:33:16.724718 run iperf3-srv_10.42.42.10(pid=22198): Terminated {rc=256} 22:33:16.772509 --- ParallelTerminationStrategy: PID 22199 died... 22:33:16.792204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22199): Terminated: ok {rc=0} 22:33:16.840063 --- ParallelTerminationStrategy: PID 22200 died... 22:33:16.859745 run iperf3-srv_10.42.42.10(pid=22200): Terminated {rc=256} 22:33:16.907463 --- ParallelTerminationStrategy: PID 22201 died... 22:33:16.927203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22201): Terminated: ok {rc=0} 22:33:16.974803 --- ParallelTerminationStrategy: PID 22202 died... 22:33:16.994491 run iperf3-srv_10.42.42.10(pid=22202): Terminated {rc=256} 22:33:17.042121 --- ParallelTerminationStrategy: PID 22205 died... 22:33:17.061928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22205): Terminated: ok {rc=0} 22:33:17.109608 --- ParallelTerminationStrategy: PID 22208 died... 22:33:17.129241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22208): Terminated: ok {rc=0} 22:33:17.177066 --- ParallelTerminationStrategy: PID 22211 died... 22:33:17.196531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22211): Terminated: ok {rc=0} 22:33:17.283822 bus /gobi_4: Setting Powered False 22:33:18.381725 bus /gobi_4: Setting Powered False 22:33:19.500577 bus /gobi_1: Setting Powered False 22:33:20.599924 bus /gobi_1: Setting Powered False 22:33:21.712720 bus /gobi_0: Setting Powered False 22:33:22.811508 bus /gobi_0: Setting Powered False 22:33:23.929149 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms ping.py ---------------------------------------------- 22:33:25.030978 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:25.042578 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 22:33:25.092528 tst ping.py: using LAC 17203 22:33:25.217885 tst ping.py: using RAC 118 22:33:25.341517 tst ping.py: using CellId 17203 22:33:25.465184 tst ping.py: using BVCI 17204 22:33:25.579652 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:25.590593 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:25.601392 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:25.612055 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:25.622759 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:25.633412 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:25.644139 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:25.654912 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:33:25.771252 tst ping.py:19: start network... 22:33:25.984041 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:33:26.474544 run create_hlr_db(pid=22213): Launched 22:33:26.602789 bus /gobi_6: Setting Powered False 22:33:27.665670 run create_hlr_db(pid=22213): Terminated: ok {rc=0} 22:33:28.089962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22215): Launched 22:33:28.386148 run osmo-hlr_10.42.42.2(pid=22216): Launched 22:33:28.499216 run osmo-stp_10.42.42.5: Starting osmo-stp 22:33:29.013572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22218): Launched 22:33:29.312123 run osmo-stp_10.42.42.5(pid=22219): Launched 22:33:29.426022 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:33:29.938839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22221): Launched 22:33:30.052079 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:33:30.303472 run patchelf(pid=22222): Launched 22:33:30.469455 run osmo-stp_10.42.42.5(pid=22219): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22219)] 22:33:30.596246 run osmo-stp_10.42.42.5(pid=22219): stdout: | (launched: 2022-12-08_22:33:29.257647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:30.724591 run osmo-stp_10.42.42.5(pid=22219): stderr: | 20221208223329428 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223329428 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223329428 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223329429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223329429 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223329429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223329429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:30.853636 run osmo-stp_10.42.42.5(pid=22219): stdout: | (launched: 2022-12-08_22:33:29.257647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:30.993954 run osmo-stp_10.42.42.5(pid=22219): stderr: | 20221208223329428 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223329428 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223329428 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223329429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223329429 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223329429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223329429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:31.154863 run patchelf(pid=22222): Terminating (SIGINT) 22:33:31.340485 run patchelf(pid=22222): Terminated: ok {rc=0} 22:33:31.475530 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22219): Process ended prematurely: osmo-stp_10.42.42.5(pid=22219) [trial-2350↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22219)] [trial-2350↪gprs:trx-lms↪ping.py:22] 22:33:31.486423 tst ping.py:22: Test FAILED (6.4 sec) 22:33:31.516480 run osmo-hlr_10.42.42.2(pid=22216): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22216)] 22:33:31.569897 run osmo-hlr_10.42.42.2(pid=22216): stdout: | (launched: 2022-12-08_22:33:28.331536) 22:33:31.624712 run osmo-hlr_10.42.42.2(pid=22216): stderr: | 20221208223328507 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223328507 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223328507 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223328507 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223328507 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223328508 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223328520 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223328530 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223328531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223328531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:33:31.681214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22215): Terminating (SIGTERM) 22:33:31.725738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22218): Terminating (SIGTERM) 22:33:31.771691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22221): Terminating (SIGTERM) 22:33:31.818322 --- ParallelTerminationStrategy: PID 22215 died... 22:33:31.839717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22215): Terminated: ok {rc=0} 22:33:31.891180 --- ParallelTerminationStrategy: PID 22218 died... 22:33:31.911934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22218): Terminated: ok {rc=0} 22:33:31.960145 --- ParallelTerminationStrategy: PID 22221 died... 22:33:31.981015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22221): Terminated: ok {rc=0} 22:33:32.071775 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 22:33:33.163212 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:33.174439 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 22:33:33.225135 tst ping_idle_ping.py: using LAC 17204 22:33:33.344016 tst ping_idle_ping.py: using RAC 119 22:33:33.462467 tst ping_idle_ping.py: using CellId 17204 22:33:33.587181 tst ping_idle_ping.py: using BVCI 17205 22:33:33.698060 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:33.708499 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:33.718845 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:33.729919 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:33.740882 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:33.751824 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:33.763046 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:33.774422 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:33:33.891067 tst ping_idle_ping.py:24: start network... 22:33:34.091268 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:33:34.553355 run create_hlr_db(pid=22223): Launched 22:33:34.667664 bus /gobi_6: Setting Powered False 22:33:35.727183 run create_hlr_db(pid=22223): Terminated: ok {rc=0} 22:33:36.164005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22225): Launched 22:33:36.483282 run osmo-hlr_10.42.42.2(pid=22226): Launched 22:33:36.605007 run osmo-stp_10.42.42.5: Starting osmo-stp 22:33:37.152330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22228): Launched 22:33:37.470352 run osmo-stp_10.42.42.5(pid=22229): Launched 22:33:37.593520 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:33:38.140335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22231): Launched 22:33:38.261479 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:33:38.529779 run patchelf(pid=22232): Launched 22:33:38.706445 run osmo-stp_10.42.42.5(pid=22229): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22229)] 22:33:38.841739 run osmo-stp_10.42.42.5(pid=22229): stdout: | (launched: 2022-12-08_22:33:37.412750) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:38.978229 run osmo-stp_10.42.42.5(pid=22229): stderr: | 20221208223337602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223337602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223337602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223337603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223337603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223337603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223337603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:39.115456 run osmo-stp_10.42.42.5(pid=22229): stdout: | (launched: 2022-12-08_22:33:37.412750) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:39.246138 run osmo-stp_10.42.42.5(pid=22229): stderr: | 20221208223337602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223337602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223337602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223337603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223337603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223337603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223337603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:39.401884 run patchelf(pid=22232): Terminating (SIGINT) 22:33:39.580659 run patchelf(pid=22232): Terminated: ok {rc=0} 22:33:39.709200 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22229): Process ended prematurely: osmo-stp_10.42.42.5(pid=22229) [trial-2350↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22229)] [trial-2350↪gprs:trx-lms↪ping_idle_ping.py:27] 22:33:39.718804 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 22:33:39.747097 run osmo-hlr_10.42.42.2(pid=22226): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22226)] 22:33:39.797959 run osmo-hlr_10.42.42.2(pid=22226): stdout: | (launched: 2022-12-08_22:33:36.425495) 22:33:39.850473 run osmo-hlr_10.42.42.2(pid=22226): stderr: | 20221208223336619 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223336619 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223336619 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223336619 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223336619 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223336619 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223336631 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223336639 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223336640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223336640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:33:39.903633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22225): Terminating (SIGTERM) 22:33:39.946233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22228): Terminating (SIGTERM) 22:33:39.989093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22231): Terminating (SIGTERM) 22:33:40.031849 --- ParallelTerminationStrategy: PID 22225 died... 22:33:40.052264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22225): Terminated: ok {rc=0} 22:33:40.099672 --- ParallelTerminationStrategy: PID 22228 died... 22:33:40.119733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22228): Terminated: ok {rc=0} 22:33:40.166673 --- ParallelTerminationStrategy: PID 22231 died... 22:33:40.186638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22231): Terminated: ok {rc=0} 22:33:40.276208 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 22:33:41.580723 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:33:41.586902 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:33:41.620745 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:33:41.660126 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:33:41.747979 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:33:41.781529 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:33:41.820350 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:33:42.414536 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:33:42.466456 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:42.477645 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:33:42.528832 tst cs_paging_gprs_active.py: using LAC 17205 22:33:42.657116 tst cs_paging_gprs_active.py: using RAC 120 22:33:42.783906 tst cs_paging_gprs_active.py: using CellId 17205 22:33:42.910904 tst cs_paging_gprs_active.py: using BVCI 17206 22:33:43.030028 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:43.041330 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:43.052280 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:43.063435 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:43.074816 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:43.085874 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:43.097035 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:43.108008 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:43.119256 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:33:43.233466 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:33:43.351570 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:33:43.570397 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:33:43.896009 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22236): Launched 22:33:44.178270 run iperf3-srv_10.42.42.10(pid=22237): Launched 22:33:44.299201 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:33:44.517545 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:33:44.842410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22238): Launched 22:33:45.123676 run iperf3-srv_10.42.42.10(pid=22239): Launched 22:33:45.245222 tst cs_paging_gprs_active.py:38: start network... 22:33:45.464148 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:33:45.995290 run create_hlr_db(pid=22240): Launched 22:33:46.181046 bus /gobi_6: Setting Powered False 22:33:47.240918 run create_hlr_db(pid=22240): Terminated: ok {rc=0} 22:33:47.711117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22242): Launched 22:33:48.035233 run osmo-hlr_10.42.42.2(pid=22243): Launched 22:33:48.157578 run osmo-stp_10.42.42.5: Starting osmo-stp 22:33:48.719602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22245): Launched 22:33:49.042138 run osmo-stp_10.42.42.5(pid=22246): Launched 22:33:49.163529 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:33:49.728107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22248): Launched 22:33:49.851604 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:33:50.125185 run patchelf(pid=22249): Launched 22:33:50.306613 run osmo-stp_10.42.42.5(pid=22246): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22246)] 22:33:50.444415 run osmo-stp_10.42.42.5(pid=22246): stdout: | (launched: 2022-12-08_22:33:48.983704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:50.583577 run osmo-stp_10.42.42.5(pid=22246): stderr: | 20221208223349177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223349177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223349177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223349178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223349178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223349178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223349178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:50.723296 run osmo-stp_10.42.42.5(pid=22246): stdout: | (launched: 2022-12-08_22:33:48.983704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:50.857382 run osmo-stp_10.42.42.5(pid=22246): stderr: | 20221208223349177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223349177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223349177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223349178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223349178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223349178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223349178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:51.016334 run patchelf(pid=22249): Terminating (SIGINT) 22:33:51.198388 run patchelf(pid=22249): Terminated: ok {rc=0} 22:33:51.329144 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22246): Process ended prematurely: osmo-stp_10.42.42.5(pid=22246) [trial-2350↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22246)] [trial-2350↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:33:51.339450 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 22:33:51.368260 run osmo-hlr_10.42.42.2(pid=22243): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22243)] 22:33:51.419444 run osmo-hlr_10.42.42.2(pid=22243): stdout: | (launched: 2022-12-08_22:33:47.976177) 22:33:51.472149 run osmo-hlr_10.42.42.2(pid=22243): stderr: | 20221208223348175 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223348176 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223348176 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223348176 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223348176 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223348176 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223348188 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223348196 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223348196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223348197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:33:51.525357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22236): Terminating (SIGTERM) 22:33:51.567592 run iperf3-srv_10.42.42.10(pid=22237): Terminating (SIGTERM) 22:33:51.609970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22238): Terminating (SIGTERM) 22:33:51.652239 run iperf3-srv_10.42.42.10(pid=22239): Terminating (SIGTERM) 22:33:51.694266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22242): Terminating (SIGTERM) 22:33:51.736394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22245): Terminating (SIGTERM) 22:33:51.778723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22248): Terminating (SIGTERM) 22:33:51.821258 --- ParallelTerminationStrategy: PID 22236 died... 22:33:51.841458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22236): Terminated: ok {rc=0} 22:33:51.888268 --- ParallelTerminationStrategy: PID 22237 died... 22:33:51.908002 run iperf3-srv_10.42.42.10(pid=22237): Terminated {rc=256} 22:33:51.954666 --- ParallelTerminationStrategy: PID 22238 died... 22:33:51.974506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22238): Terminated: ok {rc=0} 22:33:52.021334 --- ParallelTerminationStrategy: PID 22239 died... 22:33:52.040929 run iperf3-srv_10.42.42.10(pid=22239): Terminated {rc=256} 22:33:52.088386 --- ParallelTerminationStrategy: PID 22242 died... 22:33:52.108183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22242): Terminated: ok {rc=0} 22:33:52.155009 --- ParallelTerminationStrategy: PID 22245 died... 22:33:52.174837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22245): Terminated: ok {rc=0} 22:33:52.221717 --- ParallelTerminationStrategy: PID 22248 died... 22:33:52.241463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22248): Terminated: ok {rc=0} 22:33:52.330181 bus /gobi_0: Setting Powered False 22:33:53.431224 bus /gobi_0: Setting Powered False 22:33:54.548021 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:33:55.698519 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:55.710358 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:33:55.761455 tst iperf3.py: using LAC 17206 22:33:55.888632 tst iperf3.py: using RAC 121 22:33:56.016852 tst iperf3.py: using CellId 17206 22:33:56.143805 tst iperf3.py: using BVCI 17207 22:33:56.261747 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:56.273059 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:56.284022 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:56.295148 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:56.306242 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:56.317222 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:56.328346 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:56.339429 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:56.350687 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:33:56.468879 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:33:56.672936 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:33:56.978184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22250): Launched 22:33:57.242446 run iperf3-srv_10.42.42.10(pid=22251): Launched 22:33:57.357268 tst iperf3.py:8: start network... 22:33:57.560660 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:33:58.030372 run create_hlr_db(pid=22252): Launched 22:33:58.146789 bus /gobi_6: Setting Powered False 22:33:59.207599 run create_hlr_db(pid=22252): Terminated: ok {rc=0} 22:33:59.651614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22254): Launched 22:33:59.975152 run osmo-hlr_10.42.42.2(pid=22256): Launched 22:34:00.099017 run osmo-stp_10.42.42.5: Starting osmo-stp 22:34:00.655040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22258): Launched 22:34:01.017729 run osmo-stp_10.42.42.5(pid=22259): Launched 22:34:01.270240 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:34:01.931607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22261): Launched 22:34:02.083702 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:34:02.348249 run patchelf(pid=22262): Launched 22:34:02.528509 run osmo-stp_10.42.42.5(pid=22259): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22259)] 22:34:02.665587 run osmo-stp_10.42.42.5(pid=22259): stdout: | (launched: 2022-12-08_22:34:00.949077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:02.803846 run osmo-stp_10.42.42.5(pid=22259): stderr: | 20221208223401330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223401330 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223401330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223401330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223401331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223401331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223401331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:02.942483 run osmo-stp_10.42.42.5(pid=22259): stdout: | (launched: 2022-12-08_22:34:00.949077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:03.075811 run osmo-stp_10.42.42.5(pid=22259): stderr: | 20221208223401330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223401330 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223401330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223401330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223401331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223401331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223401331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:03.233648 run patchelf(pid=22262): Terminating (SIGINT) 22:34:03.415302 run patchelf(pid=22262): Terminated: ok {rc=0} 22:34:03.546212 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22259): Process ended prematurely: osmo-stp_10.42.42.5(pid=22259) [trial-2350↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22259)] [trial-2350↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 22:34:03.556316 tst iperf3.py:8: Test FAILED (7.9 sec) 22:34:03.585114 run osmo-hlr_10.42.42.2(pid=22256): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22256)] 22:34:03.635923 run osmo-hlr_10.42.42.2(pid=22256): stdout: | (launched: 2022-12-08_22:33:59.916691) 22:34:03.688745 run osmo-hlr_10.42.42.2(pid=22256): stderr: | 20221208223400113 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223400113 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223400113 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223400113 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223400113 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223400113 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223400125 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223400133 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223400133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223400133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:34:03.742017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22250): Terminating (SIGTERM) 22:34:03.784458 run iperf3-srv_10.42.42.10(pid=22251): Terminating (SIGTERM) 22:34:03.826769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22254): Terminating (SIGTERM) 22:34:03.869302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22258): Terminating (SIGTERM) 22:34:03.911918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22261): Terminating (SIGTERM) 22:34:03.954650 --- ParallelTerminationStrategy: PID 22250 died... 22:34:03.974879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22250): Terminated: ok {rc=0} 22:34:04.021973 --- ParallelTerminationStrategy: PID 22251 died... 22:34:04.041677 run iperf3-srv_10.42.42.10(pid=22251): Terminated {rc=256} 22:34:04.088690 --- ParallelTerminationStrategy: PID 22254 died... 22:34:04.108524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22254): Terminated: ok {rc=0} 22:34:04.155707 --- ParallelTerminationStrategy: PID 22258 died... 22:34:04.175649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22258): Terminated: ok {rc=0} 22:34:04.222834 --- ParallelTerminationStrategy: PID 22261 died... 22:34:04.242677 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22261): Terminated: ok {rc=0} 22:34:04.331192 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:34:05.483162 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:05.495040 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:34:05.551235 tst iperf3m4.py: using LAC 17207 22:34:05.692505 tst iperf3m4.py: using RAC 122 22:34:05.821559 tst iperf3m4.py: using CellId 17207 22:34:05.949978 tst iperf3m4.py: using BVCI 17208 22:34:06.067438 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:06.078824 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:06.089887 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:06.100867 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:06.111839 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:06.122884 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:06.134114 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:06.145041 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:06.156411 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:34:06.277417 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:34:06.395868 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:34:06.513409 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:34:06.629761 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:34:06.833568 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:34:07.137851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22263): Launched 22:34:07.403545 run iperf3-srv_10.42.42.10(pid=22264): Launched 22:34:07.518012 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:34:07.721587 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:34:08.026515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22265): Launched 22:34:08.290647 run iperf3-srv_10.42.42.10(pid=22266): Launched 22:34:08.405065 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:34:08.608595 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:34:08.913439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22267): Launched 22:34:09.177612 run iperf3-srv_10.42.42.10(pid=22268): Launched 22:34:09.292288 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:34:09.496503 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:34:09.802925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22269): Launched 22:34:10.066750 run iperf3-srv_10.42.42.10(pid=22270): Launched 22:34:10.180574 tst iperf3m4.py:8: start network... 22:34:10.384072 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:34:10.853713 run create_hlr_db(pid=22271): Launched 22:34:10.970424 bus /gobi_6: Setting Powered False 22:34:12.031991 run create_hlr_db(pid=22271): Terminated: ok {rc=0} 22:34:12.463964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22273): Launched 22:34:12.767006 run osmo-hlr_10.42.42.2(pid=22274): Launched 22:34:12.882867 run osmo-stp_10.42.42.5: Starting osmo-stp 22:34:13.417620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22276): Launched 22:34:13.721751 run osmo-stp_10.42.42.5(pid=22277): Launched 22:34:13.838069 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:34:14.361152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22279): Launched 22:34:14.477308 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:34:14.733461 run patchelf(pid=22280): Launched 22:34:14.903193 run osmo-stp_10.42.42.5(pid=22277): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22277)] 22:34:15.032350 run osmo-stp_10.42.42.5(pid=22277): stdout: | (launched: 2022-12-08_22:34:13.666287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:15.163120 run osmo-stp_10.42.42.5(pid=22277): stderr: | 20221208223413836 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223413836 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223413836 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223413837 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223413837 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223413837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223413837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:15.294105 run osmo-stp_10.42.42.5(pid=22277): stdout: | (launched: 2022-12-08_22:34:13.666287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:15.419709 run osmo-stp_10.42.42.5(pid=22277): stderr: | 20221208223413836 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223413836 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223413836 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223413837 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223413837 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223413837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223413837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:15.568564 run patchelf(pid=22280): Terminating (SIGINT) 22:34:15.739968 run patchelf(pid=22280): Terminated: ok {rc=0} 22:34:15.874431 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22277): Process ended prematurely: osmo-stp_10.42.42.5(pid=22277) [trial-2350↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22277)] [trial-2350↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 22:34:15.884600 tst iperf3m4.py:8: Test FAILED (10.4 sec) 22:34:15.914732 run osmo-hlr_10.42.42.2(pid=22274): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22274)] 22:34:15.965906 run osmo-hlr_10.42.42.2(pid=22274): stdout: | (launched: 2022-12-08_22:34:12.711818) 22:34:16.018554 run osmo-hlr_10.42.42.2(pid=22274): stderr: | 20221208223412888 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223412888 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223412888 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223412888 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223412888 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223412888 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223412900 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223412909 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223412909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223412909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:34:16.072110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22263): Terminating (SIGTERM) 22:34:16.114766 run iperf3-srv_10.42.42.10(pid=22264): Terminating (SIGTERM) 22:34:16.157299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22265): Terminating (SIGTERM) 22:34:16.199950 run iperf3-srv_10.42.42.10(pid=22266): Terminating (SIGTERM) 22:34:16.244641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22267): Terminating (SIGTERM) 22:34:16.287766 run iperf3-srv_10.42.42.10(pid=22268): Terminating (SIGTERM) 22:34:16.332117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22269): Terminating (SIGTERM) 22:34:16.375169 run iperf3-srv_10.42.42.10(pid=22270): Terminating (SIGTERM) 22:34:16.417719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22273): Terminating (SIGTERM) 22:34:16.460455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22276): Terminating (SIGTERM) 22:34:16.503404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22279): Terminating (SIGTERM) 22:34:16.546203 --- ParallelTerminationStrategy: PID 22263 died... 22:34:16.566266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22263): Terminated: ok {rc=0} 22:34:16.614419 --- ParallelTerminationStrategy: PID 22264 died... 22:34:16.634139 run iperf3-srv_10.42.42.10(pid=22264): Terminated {rc=256} 22:34:16.682074 --- ParallelTerminationStrategy: PID 22265 died... 22:34:16.702140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22265): Terminated: ok {rc=0} 22:34:16.750142 --- ParallelTerminationStrategy: PID 22266 died... 22:34:16.769927 run iperf3-srv_10.42.42.10(pid=22266): Terminated {rc=256} 22:34:16.817981 --- ParallelTerminationStrategy: PID 22267 died... 22:34:16.837737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22267): Terminated: ok {rc=0} 22:34:16.885807 --- ParallelTerminationStrategy: PID 22268 died... 22:34:16.905630 run iperf3-srv_10.42.42.10(pid=22268): Terminated {rc=256} 22:34:16.953520 --- ParallelTerminationStrategy: PID 22269 died... 22:34:16.973310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22269): Terminated: ok {rc=0} 22:34:17.021309 --- ParallelTerminationStrategy: PID 22270 died... 22:34:17.041189 run iperf3-srv_10.42.42.10(pid=22270): Terminated {rc=256} 22:34:17.089336 --- ParallelTerminationStrategy: PID 22273 died... 22:34:17.109357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22273): Terminated: ok {rc=0} 22:34:17.157234 --- ParallelTerminationStrategy: PID 22276 died... 22:34:17.176934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22276): Terminated: ok {rc=0} 22:34:17.225292 --- ParallelTerminationStrategy: PID 22279 died... 22:34:17.245264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22279): Terminated: ok {rc=0} 22:34:17.331120 bus /gobi_4: Setting Powered False 22:34:18.430409 bus /gobi_4: Setting Powered False 22:34:19.547263 bus /gobi_1: Setting Powered False 22:34:20.646612 bus /gobi_1: Setting Powered False 22:34:21.763339 bus /gobi_0: Setting Powered False 22:34:22.860800 bus /gobi_0: Setting Powered False 22:34:23.978530 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 22:34:25.082550 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:25.094131 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:34:25.144862 tst ping.py: using LAC 17208 22:34:25.264212 tst ping.py: using RAC 123 22:34:25.383957 tst ping.py: using CellId 17208 22:34:25.501399 tst ping.py: using BVCI 17209 22:34:25.611784 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:25.622607 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:25.633300 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:25.643991 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:25.654860 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:25.665701 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:25.676942 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:25.687809 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:34:25.800733 tst ping.py:19: start network... 22:34:25.999271 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:34:26.457743 run create_hlr_db(pid=22281): Launched 22:34:26.570491 bus /gobi_6: Setting Powered False 22:34:27.630038 run create_hlr_db(pid=22281): Terminated: ok {rc=0} 22:34:28.044210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22283): Launched 22:34:28.340875 run osmo-hlr_10.42.42.2(pid=22284): Launched 22:34:28.454828 run osmo-stp_10.42.42.5: Starting osmo-stp 22:34:28.970338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22286): Launched 22:34:29.267308 run osmo-stp_10.42.42.5(pid=22287): Launched 22:34:29.380924 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:34:29.893711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22289): Launched 22:34:30.007540 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:34:30.259305 run patchelf(pid=22290): Launched 22:34:30.425831 run osmo-stp_10.42.42.5(pid=22287): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22287)] 22:34:30.552549 run osmo-stp_10.42.42.5(pid=22287): stdout: | (launched: 2022-12-08_22:34:29.212757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:30.680502 run osmo-stp_10.42.42.5(pid=22287): stderr: | 20221208223429384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223429384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223429384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223429385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223429385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223429385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223429385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:30.809557 run osmo-stp_10.42.42.5(pid=22287): stdout: | (launched: 2022-12-08_22:34:29.212757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:30.933701 run osmo-stp_10.42.42.5(pid=22287): stderr: | 20221208223429384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223429384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223429384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223429385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223429385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223429385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223429385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:31.111574 run patchelf(pid=22290): Terminating (SIGINT) 22:34:31.296177 run patchelf(pid=22290): Terminated: ok {rc=0} 22:34:31.443833 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22287): Process ended prematurely: osmo-stp_10.42.42.5(pid=22287) [trial-2350↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22287)] [trial-2350↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 22:34:31.454791 tst ping.py:22: Test FAILED (6.4 sec) 22:34:31.485231 run osmo-hlr_10.42.42.2(pid=22284): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22284)] 22:34:31.538571 run osmo-hlr_10.42.42.2(pid=22284): stdout: | (launched: 2022-12-08_22:34:28.286273) 22:34:31.592918 run osmo-hlr_10.42.42.2(pid=22284): stderr: | 20221208223428462 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223428462 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223428462 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223428462 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223428462 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223428462 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223428474 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223428485 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223428486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223428486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:34:31.647527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22283): Terminating (SIGTERM) 22:34:31.693131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22286): Terminating (SIGTERM) 22:34:31.738857 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22289): Terminating (SIGTERM) 22:34:31.785583 --- ParallelTerminationStrategy: PID 22283 died... 22:34:31.806452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22283): Terminated: ok {rc=0} 22:34:31.856357 --- ParallelTerminationStrategy: PID 22286 died... 22:34:31.877980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22286): Terminated: ok {rc=0} 22:34:31.926580 --- ParallelTerminationStrategy: PID 22289 died... 22:34:31.947002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22289): Terminated: ok {rc=0} 22:34:32.037494 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:34:33.127992 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:33.139965 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:34:33.197743 tst ping_idle_ping.py: using LAC 17209 22:34:33.315355 tst ping_idle_ping.py: using RAC 124 22:34:33.431527 tst ping_idle_ping.py: using CellId 17209 22:34:33.548362 tst ping_idle_ping.py: using BVCI 17210 22:34:33.657432 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:33.668134 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:33.678734 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:33.690239 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:33.701530 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:33.712721 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:33.724170 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:33.735480 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:34:33.855667 tst ping_idle_ping.py:24: start network... 22:34:34.061153 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:34:34.525569 run create_hlr_db(pid=22291): Launched 22:34:34.639542 bus /gobi_6: Setting Powered False 22:34:35.699284 run create_hlr_db(pid=22291): Terminated: ok {rc=0} 22:34:36.135785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22293): Launched 22:34:36.454005 run osmo-hlr_10.42.42.2(pid=22294): Launched 22:34:36.575902 run osmo-stp_10.42.42.5: Starting osmo-stp 22:34:37.129090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22296): Launched 22:34:37.446868 run osmo-stp_10.42.42.5(pid=22297): Launched 22:34:37.568346 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:34:38.116445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22299): Launched 22:34:38.238054 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:34:38.507775 run patchelf(pid=22300): Launched 22:34:38.685146 run osmo-stp_10.42.42.5(pid=22297): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22297)] 22:34:38.820912 run osmo-stp_10.42.42.5(pid=22297): stdout: | (launched: 2022-12-08_22:34:37.388809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:38.957923 run osmo-stp_10.42.42.5(pid=22297): stderr: | 20221208223437581 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223437581 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223437581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223437582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223437582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223437582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223437582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:39.095216 run osmo-stp_10.42.42.5(pid=22297): stdout: | (launched: 2022-12-08_22:34:37.388809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:39.226456 run osmo-stp_10.42.42.5(pid=22297): stderr: | 20221208223437581 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223437581 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223437581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223437582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223437582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223437582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223437582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:39.382005 run patchelf(pid=22300): Terminating (SIGINT) 22:34:39.562449 run patchelf(pid=22300): Terminated: ok {rc=0} 22:34:39.691745 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22297): Process ended prematurely: osmo-stp_10.42.42.5(pid=22297) [trial-2350↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22297)] [trial-2350↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 22:34:39.701202 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:34:39.729700 run osmo-hlr_10.42.42.2(pid=22294): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22294)] 22:34:39.780382 run osmo-hlr_10.42.42.2(pid=22294): stdout: | (launched: 2022-12-08_22:34:36.395686) 22:34:39.833248 run osmo-hlr_10.42.42.2(pid=22294): stderr: | 20221208223436594 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223436594 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223436594 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223436594 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223436594 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223436594 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223436607 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223436617 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223436617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223436617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:34:39.886239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22293): Terminating (SIGTERM) 22:34:39.928741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22296): Terminating (SIGTERM) 22:34:39.971722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22299): Terminating (SIGTERM) 22:34:40.015250 --- ParallelTerminationStrategy: PID 22293 died... 22:34:40.035729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22293): Terminated: ok {rc=0} 22:34:40.083909 --- ParallelTerminationStrategy: PID 22296 died... 22:34:40.104139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22296): Terminated: ok {rc=0} 22:34:40.151817 --- ParallelTerminationStrategy: PID 22299 died... 22:34:40.171924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22299): Terminated: ok {rc=0} 22:34:40.262107 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:34:41.560222 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:34:41.566274 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:34:41.601253 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:34:41.640143 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:34:41.726342 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:34:41.759746 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:34:41.798631 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:34:42.388274 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:34:42.439251 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:42.450407 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:34:42.520213 tst cs_paging_gprs_active.py: using LAC 17210 22:34:42.640867 tst cs_paging_gprs_active.py: using RAC 125 22:34:42.760350 tst cs_paging_gprs_active.py: using CellId 17210 22:34:42.883213 tst cs_paging_gprs_active.py: using BVCI 17211 22:34:43.001547 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:43.013150 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:43.024404 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:43.036169 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:43.047539 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:43.059092 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:43.070769 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:43.082067 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:43.093563 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:34:43.209242 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:34:43.323589 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:34:43.527980 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:34:43.833205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22304): Launched 22:34:44.097510 run iperf3-srv_10.42.42.10(pid=22305): Launched 22:34:44.212236 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:34:44.416553 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:34:44.722931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22306): Launched 22:34:44.987192 run iperf3-srv_10.42.42.10(pid=22307): Launched 22:34:45.101195 tst cs_paging_gprs_active.py:38: start network... 22:34:45.304476 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:34:45.774992 run create_hlr_db(pid=22308): Launched 22:34:45.922412 bus /gobi_6: Setting Powered False 22:34:46.998846 run create_hlr_db(pid=22308): Terminated: ok {rc=0} 22:34:47.474536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22310): Launched 22:34:47.779003 run osmo-hlr_10.42.42.2(pid=22311): Launched 22:34:47.894068 run osmo-stp_10.42.42.5: Starting osmo-stp 22:34:48.429182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22313): Launched 22:34:48.732866 run osmo-stp_10.42.42.5(pid=22314): Launched 22:34:48.848831 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:34:49.372322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22316): Launched 22:34:49.489670 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:34:49.752777 run patchelf(pid=22317): Launched 22:34:49.922605 run osmo-stp_10.42.42.5(pid=22314): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22314)] 22:34:50.051508 run osmo-stp_10.42.42.5(pid=22314): stdout: | (launched: 2022-12-08_22:34:48.677517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:50.182227 run osmo-stp_10.42.42.5(pid=22314): stderr: | 20221208223448847 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223448847 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223448847 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223448847 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223448848 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223448848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223448848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:50.312710 run osmo-stp_10.42.42.5(pid=22314): stdout: | (launched: 2022-12-08_22:34:48.677517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:50.437920 run osmo-stp_10.42.42.5(pid=22314): stderr: | 20221208223448847 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223448847 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223448847 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223448847 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223448848 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223448848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223448848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:50.587244 run patchelf(pid=22317): Terminating (SIGINT) 22:34:50.758179 run patchelf(pid=22317): Terminated: ok {rc=0} 22:34:50.881605 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22314): Process ended prematurely: osmo-stp_10.42.42.5(pid=22314) [trial-2350↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22314)] [trial-2350↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:34:50.891054 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 22:34:50.919122 run osmo-hlr_10.42.42.2(pid=22311): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22311)] 22:34:50.967840 run osmo-hlr_10.42.42.2(pid=22311): stdout: | (launched: 2022-12-08_22:34:47.723443) 22:34:51.018563 run osmo-hlr_10.42.42.2(pid=22311): stderr: | 20221208223447901 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223447901 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223447901 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223447901 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223447902 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223447902 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223447914 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223447922 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223447923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223447923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:34:51.069672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22304): Terminating (SIGTERM) 22:34:51.110242 run iperf3-srv_10.42.42.10(pid=22305): Terminating (SIGTERM) 22:34:51.151095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22306): Terminating (SIGTERM) 22:34:51.191788 run iperf3-srv_10.42.42.10(pid=22307): Terminating (SIGTERM) 22:34:51.232233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22310): Terminating (SIGTERM) 22:34:51.272710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22313): Terminating (SIGTERM) 22:34:51.313426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22316): Terminating (SIGTERM) 22:34:51.354176 --- ParallelTerminationStrategy: PID 22304 died... 22:34:51.373573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22304): Terminated: ok {rc=0} 22:34:51.419511 --- ParallelTerminationStrategy: PID 22305 died... 22:34:51.438297 run iperf3-srv_10.42.42.10(pid=22305): Terminated {rc=256} 22:34:51.483103 --- ParallelTerminationStrategy: PID 22306 died... 22:34:51.501905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22306): Terminated: ok {rc=0} 22:34:51.547012 --- ParallelTerminationStrategy: PID 22307 died... 22:34:51.565940 run iperf3-srv_10.42.42.10(pid=22307): Terminated {rc=256} 22:34:51.610769 --- ParallelTerminationStrategy: PID 22310 died... 22:34:51.629590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22310): Terminated: ok {rc=0} 22:34:51.674551 --- ParallelTerminationStrategy: PID 22313 died... 22:34:51.693339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22313): Terminated: ok {rc=0} 22:34:51.738110 --- ParallelTerminationStrategy: PID 22316 died... 22:34:51.756883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22316): Terminated: ok {rc=0} 22:34:51.843522 bus /gobi_0: Setting Powered False 22:34:52.943755 bus /gobi_0: Setting Powered False 22:34:54.059660 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:34:55.207080 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:55.218459 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:34:55.288382 tst iperf3.py: using LAC 17211 22:34:55.416257 tst iperf3.py: using RAC 126 22:34:55.543859 tst iperf3.py: using CellId 17211 22:34:55.664880 tst iperf3.py: using BVCI 17212 22:34:55.775805 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:55.786840 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:55.797670 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:55.808562 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:55.819568 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:55.830429 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:55.841365 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:55.851990 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:55.862831 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:34:55.982103 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:34:56.199396 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:34:56.523385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22319): Launched 22:34:56.806590 run iperf3-srv_10.42.42.10(pid=22320): Launched 22:34:56.927833 tst iperf3.py:8: start network... 22:34:57.146067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:34:57.648723 run create_hlr_db(pid=22321): Launched 22:34:57.781698 bus /gobi_6: Setting Powered False 22:34:58.845963 run create_hlr_db(pid=22321): Terminated: ok {rc=0} 22:34:59.296032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22323): Launched 22:34:59.619412 run osmo-hlr_10.42.42.2(pid=22324): Launched 22:34:59.741953 run osmo-stp_10.42.42.5: Starting osmo-stp 22:35:00.302869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22326): Launched 22:35:00.628437 run osmo-stp_10.42.42.5(pid=22327): Launched 22:35:00.752016 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:35:01.364718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22332): Launched 22:35:01.496849 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:35:01.766634 run patchelf(pid=22333): Launched 22:35:01.953108 run osmo-stp_10.42.42.5(pid=22327): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22327)] 22:35:02.087272 run osmo-stp_10.42.42.5(pid=22327): stdout: | (launched: 2022-12-08_22:35:00.569424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:02.221575 run osmo-stp_10.42.42.5(pid=22327): stderr: | 20221208223500764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223500765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223500765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223500765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223500766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223500766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223500766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:02.354681 run osmo-stp_10.42.42.5(pid=22327): stdout: | (launched: 2022-12-08_22:35:00.569424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:02.480865 run osmo-stp_10.42.42.5(pid=22327): stderr: | 20221208223500764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223500765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223500765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223500765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223500766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223500766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223500766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:02.630603 run patchelf(pid=22333): Terminating (SIGINT) 22:35:02.803531 run patchelf(pid=22333): Terminated: ok {rc=0} 22:35:02.927521 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22327): Process ended prematurely: osmo-stp_10.42.42.5(pid=22327) [trial-2350↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22327)] [trial-2350↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 22:35:02.937392 tst iperf3.py:8: Test FAILED (7.8 sec) 22:35:02.966329 run osmo-hlr_10.42.42.2(pid=22324): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22324)] 22:35:03.015666 run osmo-hlr_10.42.42.2(pid=22324): stdout: | (launched: 2022-12-08_22:34:59.561242) 22:35:03.067168 run osmo-hlr_10.42.42.2(pid=22324): stderr: | 20221208223459758 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223459758 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223459758 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223459758 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223459758 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223459758 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223459770 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223459781 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223459781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223459781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:35:03.118590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22319): Terminating (SIGTERM) 22:35:03.160172 run iperf3-srv_10.42.42.10(pid=22320): Terminating (SIGTERM) 22:35:03.201612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22323): Terminating (SIGTERM) 22:35:03.242871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22326): Terminating (SIGTERM) 22:35:03.284174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22332): Terminating (SIGTERM) 22:35:03.325748 --- ParallelTerminationStrategy: PID 22319 died... 22:35:03.345027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22319): Terminated: ok {rc=0} 22:35:03.391111 --- ParallelTerminationStrategy: PID 22320 died... 22:35:03.410295 run iperf3-srv_10.42.42.10(pid=22320): Terminated {rc=256} 22:35:03.456236 --- ParallelTerminationStrategy: PID 22323 died... 22:35:03.475322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22323): Terminated: ok {rc=0} 22:35:03.521049 --- ParallelTerminationStrategy: PID 22326 died... 22:35:03.540486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22326): Terminated: ok {rc=0} 22:35:03.586261 --- ParallelTerminationStrategy: PID 22332 died... 22:35:03.605633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22332): Terminated: ok {rc=0} 22:35:03.694257 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:35:04.842824 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:04.854361 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:35:04.927797 tst iperf3m4.py: using LAC 17212 22:35:05.054112 tst iperf3m4.py: using RAC 127 22:35:05.180867 tst iperf3m4.py: using CellId 17212 22:35:05.301372 tst iperf3m4.py: using BVCI 17213 22:35:05.411618 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:05.422580 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:05.433602 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:05.444643 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:05.455469 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:05.466307 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:05.477001 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:05.487986 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:05.499881 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:35:05.619800 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:35:05.737719 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:35:05.856771 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:35:05.976406 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:35:06.194733 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:35:06.519624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22334): Launched 22:35:06.802270 run iperf3-srv_10.42.42.10(pid=22335): Launched 22:35:06.923561 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:35:07.141939 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:35:07.467684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22336): Launched 22:35:07.748657 run iperf3-srv_10.42.42.10(pid=22337): Launched 22:35:07.870171 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:35:08.087901 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:35:08.413369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22338): Launched 22:35:08.696591 run iperf3-srv_10.42.42.10(pid=22339): Launched 22:35:08.818137 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:35:09.036065 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:35:09.360772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22340): Launched 22:35:09.642205 run iperf3-srv_10.42.42.10(pid=22341): Launched 22:35:09.763324 tst iperf3m4.py:8: start network... 22:35:09.981072 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:35:10.484115 run create_hlr_db(pid=22342): Launched 22:35:10.615386 bus /gobi_6: Setting Powered False 22:35:11.679574 run create_hlr_db(pid=22342): Terminated: ok {rc=0} 22:35:12.112619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22344): Launched 22:35:12.436634 run osmo-hlr_10.42.42.2(pid=22345): Launched 22:35:12.559445 run osmo-stp_10.42.42.5: Starting osmo-stp 22:35:13.123329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22347): Launched 22:35:13.446750 run osmo-stp_10.42.42.5(pid=22348): Launched 22:35:13.569858 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:35:14.127140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22350): Launched 22:35:14.250939 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:35:14.524209 run patchelf(pid=22351): Launched 22:35:14.704015 run osmo-stp_10.42.42.5(pid=22348): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22348)] 22:35:14.841797 run osmo-stp_10.42.42.5(pid=22348): stdout: | (launched: 2022-12-08_22:35:13.387806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:14.980374 run osmo-stp_10.42.42.5(pid=22348): stderr: | 20221208223513580 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223513580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223513580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223513581 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223513581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223513581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223513581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:15.119300 run osmo-stp_10.42.42.5(pid=22348): stdout: | (launched: 2022-12-08_22:35:13.387806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:15.252592 run osmo-stp_10.42.42.5(pid=22348): stderr: | 20221208223513580 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223513580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223513580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223513581 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223513581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223513581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223513581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:15.410155 run patchelf(pid=22351): Terminating (SIGINT) 22:35:15.592727 run patchelf(pid=22351): Terminated: ok {rc=0} 22:35:15.723559 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22348): Process ended prematurely: osmo-stp_10.42.42.5(pid=22348) [trial-2350↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22348)] [trial-2350↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:35:15.733749 tst iperf3m4.py:8: Test FAILED (10.9 sec) 22:35:15.762976 run osmo-hlr_10.42.42.2(pid=22345): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22345)] 22:35:15.813983 run osmo-hlr_10.42.42.2(pid=22345): stdout: | (launched: 2022-12-08_22:35:12.378000) 22:35:15.890254 run osmo-hlr_10.42.42.2(pid=22345): stderr: | 20221208223512575 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223512575 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223512575 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223512575 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223512575 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223512575 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223512589 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223512597 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223512597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223512597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:35:15.945412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22334): Terminating (SIGTERM) 22:35:15.989214 run iperf3-srv_10.42.42.10(pid=22335): Terminating (SIGTERM) 22:35:16.033952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22336): Terminating (SIGTERM) 22:35:16.078183 run iperf3-srv_10.42.42.10(pid=22337): Terminating (SIGTERM) 22:35:16.125877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22338): Terminating (SIGTERM) 22:35:16.170206 run iperf3-srv_10.42.42.10(pid=22339): Terminating (SIGTERM) 22:35:16.216784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22340): Terminating (SIGTERM) 22:35:16.260740 run iperf3-srv_10.42.42.10(pid=22341): Terminating (SIGTERM) 22:35:16.308439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22344): Terminating (SIGTERM) 22:35:16.351729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22347): Terminating (SIGTERM) 22:35:16.395254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22350): Terminating (SIGTERM) 22:35:16.441139 --- ParallelTerminationStrategy: PID 22334 died... 22:35:16.461397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22334): Terminated: ok {rc=0} 22:35:16.512346 --- ParallelTerminationStrategy: PID 22335 died... 22:35:16.532712 run iperf3-srv_10.42.42.10(pid=22335): Terminated {rc=256} 22:35:16.583083 --- ParallelTerminationStrategy: PID 22336 died... 22:35:16.603438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22336): Terminated: ok {rc=0} 22:35:16.652143 --- ParallelTerminationStrategy: PID 22337 died... 22:35:16.672707 run iperf3-srv_10.42.42.10(pid=22337): Terminated {rc=256} 22:35:16.722951 --- ParallelTerminationStrategy: PID 22338 died... 22:35:16.743024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22338): Terminated: ok {rc=0} 22:35:16.793098 --- ParallelTerminationStrategy: PID 22339 died... 22:35:16.813467 run iperf3-srv_10.42.42.10(pid=22339): Terminated {rc=256} 22:35:16.862196 --- ParallelTerminationStrategy: PID 22340 died... 22:35:16.883365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22340): Terminated: ok {rc=0} 22:35:16.932339 --- ParallelTerminationStrategy: PID 22341 died... 22:35:16.953070 run iperf3-srv_10.42.42.10(pid=22341): Terminated {rc=256} 22:35:17.011984 --- ParallelTerminationStrategy: PID 22344 died... 22:35:17.035848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22344): Terminated: ok {rc=0} 22:35:17.095715 --- ParallelTerminationStrategy: PID 22347 died... 22:35:17.118190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22347): Terminated: ok {rc=0} 22:35:17.166887 --- ParallelTerminationStrategy: PID 22350 died... 22:35:17.187523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22350): Terminated: ok {rc=0} 22:35:17.277821 bus /gobi_4: Setting Powered False 22:35:18.378300 bus /gobi_4: Setting Powered False 22:35:19.497848 bus /gobi_1: Setting Powered False 22:35:20.598300 bus /gobi_1: Setting Powered False 22:35:21.715705 bus /gobi_0: Setting Powered False 22:35:22.814942 bus /gobi_0: Setting Powered False 22:35:23.933691 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:35:25.037569 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:25.049853 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:35:25.124067 tst ping.py: using LAC 17213 22:35:25.248475 tst ping.py: using RAC 128 22:35:25.371936 tst ping.py: using CellId 17213 22:35:25.503859 tst ping.py: using BVCI 17214 22:35:25.620538 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:25.631947 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:25.643052 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:25.654189 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:25.665215 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:25.676304 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:25.687498 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:25.698599 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:35:25.816771 tst ping.py:19: start network... 22:35:26.029186 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:35:26.519936 run create_hlr_db(pid=22352): Launched 22:35:26.649270 bus /gobi_6: Setting Powered False 22:35:27.712408 run create_hlr_db(pid=22352): Terminated: ok {rc=0} 22:35:28.155003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22354): Launched 22:35:28.472448 run osmo-hlr_10.42.42.2(pid=22355): Launched 22:35:28.593718 run osmo-stp_10.42.42.5: Starting osmo-stp 22:35:29.142347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22357): Launched 22:35:29.458855 run osmo-stp_10.42.42.5(pid=22358): Launched 22:35:29.580290 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:35:30.130050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22360): Launched 22:35:30.251117 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:35:30.519996 run patchelf(pid=22361): Launched 22:35:30.697895 run osmo-stp_10.42.42.5(pid=22358): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22358)] 22:35:30.833294 run osmo-stp_10.42.42.5(pid=22358): stdout: | (launched: 2022-12-08_22:35:29.401301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:30.993331 run osmo-stp_10.42.42.5(pid=22358): stderr: | 20221208223529592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223529594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223529594 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223529594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223529595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223529595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223529595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:31.145187 run osmo-stp_10.42.42.5(pid=22358): stdout: | (launched: 2022-12-08_22:35:29.401301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:31.279067 run osmo-stp_10.42.42.5(pid=22358): stderr: | 20221208223529592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223529594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223529594 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223529594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223529595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223529595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223529595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:31.437306 run patchelf(pid=22361): Terminating (SIGINT) 22:35:31.650610 run patchelf(pid=22361): Terminated: ok {rc=0} 22:35:31.781744 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22358): Process ended prematurely: osmo-stp_10.42.42.5(pid=22358) [trial-2350↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22358)] [trial-2350↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 22:35:31.792370 tst ping.py:22: Test FAILED (6.7 sec) 22:35:31.822787 run osmo-hlr_10.42.42.2(pid=22355): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22355)] 22:35:31.874991 run osmo-hlr_10.42.42.2(pid=22355): stdout: | (launched: 2022-12-08_22:35:28.414429) 22:35:31.929391 run osmo-hlr_10.42.42.2(pid=22355): stderr: | 20221208223528614 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223528614 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223528614 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223528614 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223528614 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223528615 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223528627 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223528637 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223528637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223528637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:35:31.984332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22354): Terminating (SIGTERM) 22:35:32.035970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22357): Terminating (SIGTERM) 22:35:32.093909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22360): Terminating (SIGTERM) 22:35:32.149887 --- ParallelTerminationStrategy: PID 22354 died... 22:35:32.174826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22354): Terminated: ok {rc=0} 22:35:32.230264 --- ParallelTerminationStrategy: PID 22357 died... 22:35:32.250413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22357): Terminated: ok {rc=0} 22:35:32.300736 --- ParallelTerminationStrategy: PID 22360 died... 22:35:32.321436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22360): Terminated: ok {rc=0} 22:35:32.408514 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:35:33.494923 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:33.506527 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:35:33.582056 tst ping_idle_ping.py: using LAC 17214 22:35:33.702371 tst ping_idle_ping.py: using RAC 129 22:35:33.821329 tst ping_idle_ping.py: using CellId 17214 22:35:33.937652 tst ping_idle_ping.py: using BVCI 17215 22:35:34.053783 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:34.065386 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:34.076591 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:34.087812 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:34.099150 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:34.110576 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:34.121866 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:34.133001 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:35:34.249406 tst ping_idle_ping.py:24: start network... 22:35:34.464578 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:35:34.962097 run create_hlr_db(pid=22362): Launched 22:35:35.091411 bus /gobi_6: Setting Powered False 22:35:36.155031 run create_hlr_db(pid=22362): Terminated: ok {rc=0} 22:35:36.582927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22364): Launched 22:35:36.880710 run osmo-hlr_10.42.42.2(pid=22365): Launched 22:35:36.994276 run osmo-stp_10.42.42.5: Starting osmo-stp 22:35:37.522786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22367): Launched 22:35:37.820433 run osmo-stp_10.42.42.5(pid=22368): Launched 22:35:37.934414 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:35:38.450588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22370): Launched 22:35:38.564773 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:35:38.818041 run patchelf(pid=22371): Launched 22:35:38.985363 run osmo-stp_10.42.42.5(pid=22368): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22368)] 22:35:39.113653 run osmo-stp_10.42.42.5(pid=22368): stdout: | (launched: 2022-12-08_22:35:37.765895) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:39.242944 run osmo-stp_10.42.42.5(pid=22368): stderr: | 20221208223537935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223537935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223537936 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223537936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223537937 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223537937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223537937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:39.372816 run osmo-stp_10.42.42.5(pid=22368): stdout: | (launched: 2022-12-08_22:35:37.765895) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:39.496745 run osmo-stp_10.42.42.5(pid=22368): stderr: | 20221208223537935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223537935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223537936 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223537936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223537937 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223537937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223537937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:39.643272 run patchelf(pid=22371): Terminating (SIGINT) 22:35:39.812570 run patchelf(pid=22371): Terminated: ok {rc=0} 22:35:39.934842 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22368): Process ended prematurely: osmo-stp_10.42.42.5(pid=22368) [trial-2350↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22368)] [trial-2350↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:35:39.943692 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:35:39.971493 run osmo-hlr_10.42.42.2(pid=22365): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22365)] 22:35:40.020786 run osmo-hlr_10.42.42.2(pid=22365): stdout: | (launched: 2022-12-08_22:35:36.825988) 22:35:40.071655 run osmo-hlr_10.42.42.2(pid=22365): stderr: | 20221208223537001 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223537001 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223537001 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223537001 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223537001 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223537001 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223537013 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223537022 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223537022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223537022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:35:40.123359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22364): Terminating (SIGTERM) 22:35:40.164397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22367): Terminating (SIGTERM) 22:35:40.205522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22370): Terminating (SIGTERM) 22:35:40.246848 --- ParallelTerminationStrategy: PID 22364 died... 22:35:40.266458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22364): Terminated: ok {rc=0} 22:35:40.312586 --- ParallelTerminationStrategy: PID 22367 died... 22:35:40.331697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22367): Terminated: ok {rc=0} 22:35:40.378038 --- ParallelTerminationStrategy: PID 22370 died... 22:35:40.397310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22370): Terminated: ok {rc=0} 22:35:40.483842 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:35:41.794337 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:35:41.800659 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:35:41.837692 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 22:35:41.875912 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 22:35:41.962008 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:35:41.994573 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 22:35:42.032918 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 22:35:42.630865 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 22:35:42.684527 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:42.695712 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:35:42.768083 tst cs_paging_gprs_active.py: using LAC 17215 22:35:42.897526 tst cs_paging_gprs_active.py: using RAC 130 22:35:43.026799 tst cs_paging_gprs_active.py: using CellId 17215 22:35:43.150282 tst cs_paging_gprs_active.py: using BVCI 17216 22:35:43.261997 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:43.272939 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:43.284257 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:43.295455 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:43.306628 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:43.317818 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:43.328996 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:43.339996 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:43.351217 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:35:43.471448 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:35:43.593128 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:35:43.796590 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:35:44.100458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22376): Launched 22:35:44.364725 run iperf3-srv_10.42.42.10(pid=22377): Launched 22:35:44.479451 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:35:44.682747 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:35:44.988272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22378): Launched 22:35:45.253219 run iperf3-srv_10.42.42.10(pid=22379): Launched 22:35:45.367663 tst cs_paging_gprs_active.py:38: start network... 22:35:45.571219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:35:46.048415 run create_hlr_db(pid=22380): Launched 22:35:46.173839 bus /gobi_6: Setting Powered False 22:35:47.233492 run create_hlr_db(pid=22380): Terminated: ok {rc=0} 22:35:47.660116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22382): Launched 22:35:47.964554 run osmo-hlr_10.42.42.2(pid=22383): Launched 22:35:48.080456 run osmo-stp_10.42.42.5: Starting osmo-stp 22:35:48.605711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22385): Launched 22:35:48.910781 run osmo-stp_10.42.42.5(pid=22386): Launched 22:35:49.027621 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:35:49.551930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22388): Launched 22:35:49.669376 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:35:49.926551 run patchelf(pid=22389): Launched 22:35:50.097964 run osmo-stp_10.42.42.5(pid=22386): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22386)] 22:35:50.227224 run osmo-stp_10.42.42.5(pid=22386): stdout: | (launched: 2022-12-08_22:35:48.855008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:50.357612 run osmo-stp_10.42.42.5(pid=22386): stderr: | 20221208223549023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223549023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223549023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223549024 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223549026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223549026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223549026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:50.488786 run osmo-stp_10.42.42.5(pid=22386): stdout: | (launched: 2022-12-08_22:35:48.855008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:50.614688 run osmo-stp_10.42.42.5(pid=22386): stderr: | 20221208223549023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223549023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223549023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223549024 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223549026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223549026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223549026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:50.763303 run patchelf(pid=22389): Terminating (SIGINT) 22:35:50.934749 run patchelf(pid=22389): Terminated: ok {rc=0} 22:35:51.058974 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22386): Process ended prematurely: osmo-stp_10.42.42.5(pid=22386) [trial-2350↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22386)] [trial-2350↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 22:35:51.068582 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 22:35:51.097843 run osmo-hlr_10.42.42.2(pid=22383): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22383)] 22:35:51.148545 run osmo-hlr_10.42.42.2(pid=22383): stdout: | (launched: 2022-12-08_22:35:47.909390) 22:35:51.201051 run osmo-hlr_10.42.42.2(pid=22383): stderr: | 20221208223548083 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223548083 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223548083 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223548083 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223548083 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223548083 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223548096 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223548105 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223548105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223548105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:35:51.253974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22376): Terminating (SIGTERM) 22:35:51.296232 run iperf3-srv_10.42.42.10(pid=22377): Terminating (SIGTERM) 22:35:51.338561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22378): Terminating (SIGTERM) 22:35:51.381073 run iperf3-srv_10.42.42.10(pid=22379): Terminating (SIGTERM) 22:35:51.423140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22382): Terminating (SIGTERM) 22:35:51.465573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22385): Terminating (SIGTERM) 22:35:51.507808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22388): Terminating (SIGTERM) 22:35:51.550604 --- ParallelTerminationStrategy: PID 22376 died... 22:35:51.570615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22376): Terminated: ok {rc=0} 22:35:51.618020 --- ParallelTerminationStrategy: PID 22377 died... 22:35:51.638102 run iperf3-srv_10.42.42.10(pid=22377): Terminated {rc=256} 22:35:51.685133 --- ParallelTerminationStrategy: PID 22378 died... 22:35:51.704923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22378): Terminated: ok {rc=0} 22:35:51.751862 --- ParallelTerminationStrategy: PID 22379 died... 22:35:51.771645 run iperf3-srv_10.42.42.10(pid=22379): Terminated {rc=256} 22:35:51.818940 --- ParallelTerminationStrategy: PID 22382 died... 22:35:51.838820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22382): Terminated: ok {rc=0} 22:35:51.885685 --- ParallelTerminationStrategy: PID 22385 died... 22:35:51.905513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22385): Terminated: ok {rc=0} 22:35:51.952113 --- ParallelTerminationStrategy: PID 22388 died... 22:35:51.971960 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22388): Terminated: ok {rc=0} 22:35:52.059972 bus /gobi_0: Setting Powered False 22:35:53.161646 bus /gobi_0: Setting Powered False 22:35:54.278270 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 22:35:55.427805 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:55.439751 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:35:55.514992 tst iperf3.py: using LAC 17216 22:35:55.641323 tst iperf3.py: using RAC 131 22:35:55.766726 tst iperf3.py: using CellId 17216 22:35:55.896411 tst iperf3.py: using BVCI 17217 22:35:56.014080 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:56.025452 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:56.036589 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:56.047768 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:56.058819 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:56.069965 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:56.081212 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:56.092292 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:56.103494 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:35:56.218153 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:35:56.421444 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:35:56.734686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22391): Launched 22:35:56.999216 run iperf3-srv_10.42.42.10(pid=22392): Launched 22:35:57.114370 tst iperf3.py:8: start network... 22:35:57.317947 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:35:57.789840 run create_hlr_db(pid=22393): Launched 22:35:57.906352 bus /gobi_6: Setting Powered False 22:35:58.967409 run create_hlr_db(pid=22393): Terminated: ok {rc=0} 22:35:59.411565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22395): Launched 22:35:59.721392 run osmo-hlr_10.42.42.2(pid=22396): Launched 22:35:59.837138 run osmo-stp_10.42.42.5: Starting osmo-stp 22:36:00.378754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22398): Launched 22:36:00.682700 run osmo-stp_10.42.42.5(pid=22399): Launched 22:36:00.800138 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:36:01.340794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22401): Launched 22:36:01.471115 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:36:01.738109 run patchelf(pid=22402): Launched 22:36:01.919940 run osmo-stp_10.42.42.5(pid=22399): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22399)] 22:36:02.052629 run osmo-stp_10.42.42.5(pid=22399): stdout: | (launched: 2022-12-08_22:36:00.627472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:02.186725 run osmo-stp_10.42.42.5(pid=22399): stderr: | 20221208223600800 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223600800 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223600800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223600801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223600801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223600801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223600801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:02.320709 run osmo-stp_10.42.42.5(pid=22399): stdout: | (launched: 2022-12-08_22:36:00.627472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:02.447620 run osmo-stp_10.42.42.5(pid=22399): stderr: | 20221208223600800 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223600800 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223600800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223600801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223600801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223600801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223600801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:02.596701 run patchelf(pid=22402): Terminating (SIGINT) 22:36:02.768633 run patchelf(pid=22402): Terminated: ok {rc=0} 22:36:02.892173 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22399): Process ended prematurely: osmo-stp_10.42.42.5(pid=22399) [trial-2350↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22399)] [trial-2350↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 22:36:02.901948 tst iperf3.py:8: Test FAILED (7.5 sec) 22:36:02.930579 run osmo-hlr_10.42.42.2(pid=22396): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22396)] 22:36:02.979570 run osmo-hlr_10.42.42.2(pid=22396): stdout: | (launched: 2022-12-08_22:35:59.665589) 22:36:03.030436 run osmo-hlr_10.42.42.2(pid=22396): stderr: | 20221208223559843 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223559843 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223559843 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223559843 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223559843 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223559843 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223559855 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223559863 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223559863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223559863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:36:03.081495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22391): Terminating (SIGTERM) 22:36:03.122845 run iperf3-srv_10.42.42.10(pid=22392): Terminating (SIGTERM) 22:36:03.163976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22395): Terminating (SIGTERM) 22:36:03.205295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22398): Terminating (SIGTERM) 22:36:03.246608 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22401): Terminating (SIGTERM) 22:36:03.288656 --- ParallelTerminationStrategy: PID 22391 died... 22:36:03.308062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22391): Terminated: ok {rc=0} 22:36:03.354118 --- ParallelTerminationStrategy: PID 22392 died... 22:36:03.373275 run iperf3-srv_10.42.42.10(pid=22392): Terminated {rc=256} 22:36:03.419258 --- ParallelTerminationStrategy: PID 22395 died... 22:36:03.438561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22395): Terminated: ok {rc=0} 22:36:03.484401 --- ParallelTerminationStrategy: PID 22398 died... 22:36:03.503685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22398): Terminated: ok {rc=0} 22:36:03.550108 --- ParallelTerminationStrategy: PID 22401 died... 22:36:03.569408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22401): Terminated: ok {rc=0} 22:36:03.657221 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 22:36:04.808365 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:04.820291 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:36:04.892562 tst iperf3m4.py: using LAC 17217 22:36:05.019791 tst iperf3m4.py: using RAC 132 22:36:05.147804 tst iperf3m4.py: using CellId 17217 22:36:05.276745 tst iperf3m4.py: using BVCI 17218 22:36:05.394749 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:05.406158 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:05.417203 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:05.428167 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:05.439169 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:05.450209 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:05.461425 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:05.472676 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:05.483889 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:36:05.603560 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:36:05.722727 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:36:05.837983 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:36:05.952843 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:36:06.158141 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:36:06.463889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22403): Launched 22:36:06.729884 run iperf3-srv_10.42.42.10(pid=22404): Launched 22:36:06.845679 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:36:07.050402 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:36:07.358728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22405): Launched 22:36:07.623828 run iperf3-srv_10.42.42.10(pid=22406): Launched 22:36:07.738339 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:36:07.942192 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:36:08.248709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22407): Launched 22:36:08.514167 run iperf3-srv_10.42.42.10(pid=22408): Launched 22:36:08.628712 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:36:08.832755 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:36:09.139287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22409): Launched 22:36:09.404768 run iperf3-srv_10.42.42.10(pid=22410): Launched 22:36:09.519474 tst iperf3m4.py:8: start network... 22:36:09.722678 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:36:10.194007 run create_hlr_db(pid=22411): Launched 22:36:10.311978 bus /gobi_6: Setting Powered False 22:36:11.372558 run create_hlr_db(pid=22411): Terminated: ok {rc=0} 22:36:11.797427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22413): Launched 22:36:12.103051 run osmo-hlr_10.42.42.2(pid=22414): Launched 22:36:12.219219 run osmo-stp_10.42.42.5: Starting osmo-stp 22:36:12.761033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22416): Launched 22:36:13.065059 run osmo-stp_10.42.42.5(pid=22417): Launched 22:36:13.181240 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:36:13.705491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22419): Launched 22:36:13.822538 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:36:14.081197 run patchelf(pid=22420): Launched 22:36:14.251245 run osmo-stp_10.42.42.5(pid=22417): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22417)] 22:36:14.380700 run osmo-stp_10.42.42.5(pid=22417): stdout: | (launched: 2022-12-08_22:36:13.009185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:14.511828 run osmo-stp_10.42.42.5(pid=22417): stderr: | 20221208223613180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223613180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223613180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223613181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223613181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223613181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223613181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:14.643026 run osmo-stp_10.42.42.5(pid=22417): stdout: | (launched: 2022-12-08_22:36:13.009185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:14.769134 run osmo-stp_10.42.42.5(pid=22417): stderr: | 20221208223613180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223613180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223613180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223613181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223613181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223613181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223613181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:14.917873 run patchelf(pid=22420): Terminating (SIGINT) 22:36:15.089703 run patchelf(pid=22420): Terminated: ok {rc=0} 22:36:15.213881 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22417): Process ended prematurely: osmo-stp_10.42.42.5(pid=22417) [trial-2350↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22417)] [trial-2350↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 22:36:15.223434 tst iperf3m4.py:8: Test FAILED (10.5 sec) 22:36:15.252200 run osmo-hlr_10.42.42.2(pid=22414): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22414)] 22:36:15.301569 run osmo-hlr_10.42.42.2(pid=22414): stdout: | (launched: 2022-12-08_22:36:12.047200) 22:36:15.352629 run osmo-hlr_10.42.42.2(pid=22414): stderr: | 20221208223612222 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223612222 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223612222 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223612222 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223612222 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223612222 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223612232 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223612241 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223612241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223612241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:36:15.404066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22403): Terminating (SIGTERM) 22:36:15.445259 run iperf3-srv_10.42.42.10(pid=22404): Terminating (SIGTERM) 22:36:15.486429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22405): Terminating (SIGTERM) 22:36:15.527651 run iperf3-srv_10.42.42.10(pid=22406): Terminating (SIGTERM) 22:36:15.568448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22407): Terminating (SIGTERM) 22:36:15.609447 run iperf3-srv_10.42.42.10(pid=22408): Terminating (SIGTERM) 22:36:15.650357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22409): Terminating (SIGTERM) 22:36:15.691400 run iperf3-srv_10.42.42.10(pid=22410): Terminating (SIGTERM) 22:36:15.732320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22413): Terminating (SIGTERM) 22:36:15.773067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22416): Terminating (SIGTERM) 22:36:15.813974 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22419): Terminating (SIGTERM) 22:36:15.855914 --- ParallelTerminationStrategy: PID 22403 died... 22:36:15.875423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22403): Terminated: ok {rc=0} 22:36:15.922439 --- ParallelTerminationStrategy: PID 22404 died... 22:36:15.942016 run iperf3-srv_10.42.42.10(pid=22404): Terminated {rc=256} 22:36:15.988528 --- ParallelTerminationStrategy: PID 22405 died... 22:36:16.008282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22405): Terminated: ok {rc=0} 22:36:16.054841 --- ParallelTerminationStrategy: PID 22406 died... 22:36:16.074414 run iperf3-srv_10.42.42.10(pid=22406): Terminated {rc=256} 22:36:16.120920 --- ParallelTerminationStrategy: PID 22407 died... 22:36:16.140713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22407): Terminated: ok {rc=0} 22:36:16.187439 --- ParallelTerminationStrategy: PID 22408 died... 22:36:16.207034 run iperf3-srv_10.42.42.10(pid=22408): Terminated {rc=256} 22:36:16.253744 --- ParallelTerminationStrategy: PID 22409 died... 22:36:16.273454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22409): Terminated: ok {rc=0} 22:36:16.320438 --- ParallelTerminationStrategy: PID 22410 died... 22:36:16.340157 run iperf3-srv_10.42.42.10(pid=22410): Terminated {rc=256} 22:36:16.386792 --- ParallelTerminationStrategy: PID 22413 died... 22:36:16.406684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22413): Terminated: ok {rc=0} 22:36:16.453471 --- ParallelTerminationStrategy: PID 22416 died... 22:36:16.472866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22416): Terminated: ok {rc=0} 22:36:16.519883 --- ParallelTerminationStrategy: PID 22419 died... 22:36:16.539728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22419): Terminated: ok {rc=0} 22:36:16.631405 bus /gobi_4: Setting Powered False 22:36:17.739512 bus /gobi_4: Setting Powered False 22:36:18.857752 bus /gobi_1: Setting Powered False 22:36:19.959977 bus /gobi_1: Setting Powered False 22:36:21.079425 bus /gobi_0: Setting Powered False 22:36:22.180824 bus /gobi_0: Setting Powered False 22:36:23.299251 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 22:36:24.404053 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:24.416207 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:36:24.495896 tst ping.py: using LAC 17218 22:36:24.633295 tst ping.py: using RAC 133 22:36:24.759638 tst ping.py: using CellId 17218 22:36:24.884211 tst ping.py: using BVCI 17219 22:36:24.999809 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:25.011063 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:25.022253 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:25.033355 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:25.044310 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:25.055369 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:25.066569 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:25.077675 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:36:25.195030 tst ping.py:19: start network... 22:36:25.410810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:36:25.903573 run create_hlr_db(pid=22421): Launched 22:36:26.032910 bus /gobi_6: Setting Powered False 22:36:27.096485 run create_hlr_db(pid=22421): Terminated: ok {rc=0} 22:36:27.542703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22423): Launched 22:36:27.861724 run osmo-hlr_10.42.42.2(pid=22424): Launched 22:36:27.983109 run osmo-stp_10.42.42.5: Starting osmo-stp 22:36:28.539739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22426): Launched 22:36:28.857621 run osmo-stp_10.42.42.5(pid=22427): Launched 22:36:28.979745 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:36:29.534745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22429): Launched 22:36:29.657012 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:36:29.927031 run patchelf(pid=22430): Launched 22:36:30.105258 run osmo-stp_10.42.42.5(pid=22427): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22427)] 22:36:30.241579 run osmo-stp_10.42.42.5(pid=22427): stdout: | (launched: 2022-12-08_22:36:28.799512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:30.379165 run osmo-stp_10.42.42.5(pid=22427): stderr: | 20221208223628990 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223628990 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223628991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223628991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223628992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223628992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223628992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:30.517073 run osmo-stp_10.42.42.5(pid=22427): stdout: | (launched: 2022-12-08_22:36:28.799512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:30.648898 run osmo-stp_10.42.42.5(pid=22427): stderr: | 20221208223628990 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223628990 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223628991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223628991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223628992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223628992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223628992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:30.804924 run patchelf(pid=22430): Terminating (SIGINT) 22:36:30.996550 run patchelf(pid=22430): Terminated: ok {rc=0} 22:36:31.131033 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22427): Process ended prematurely: osmo-stp_10.42.42.5(pid=22427) [trial-2350↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22427)] [trial-2350↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 22:36:31.141203 tst ping.py:22: Test FAILED (6.7 sec) 22:36:31.173052 run osmo-hlr_10.42.42.2(pid=22424): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22424)] 22:36:31.225536 run osmo-hlr_10.42.42.2(pid=22424): stdout: | (launched: 2022-12-08_22:36:27.803889) 22:36:31.279442 run osmo-hlr_10.42.42.2(pid=22424): stderr: | 20221208223627999 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223627999 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223627999 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223627999 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223627999 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223627999 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223628011 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223628020 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223628020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223628020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:36:31.335939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22423): Terminating (SIGTERM) 22:36:31.381512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22426): Terminating (SIGTERM) 22:36:31.427673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22429): Terminating (SIGTERM) 22:36:31.474337 --- ParallelTerminationStrategy: PID 22423 died... 22:36:31.496088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22423): Terminated: ok {rc=0} 22:36:31.547288 --- ParallelTerminationStrategy: PID 22426 died... 22:36:31.568101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22426): Terminated: ok {rc=0} 22:36:31.617677 --- ParallelTerminationStrategy: PID 22429 died... 22:36:31.638540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22429): Terminated: ok {rc=0} 22:36:31.731284 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 22:36:32.821453 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:32.833520 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:36:32.905868 tst ping_idle_ping.py: using LAC 17219 22:36:33.027371 tst ping_idle_ping.py: using RAC 134 22:36:33.147264 tst ping_idle_ping.py: using CellId 17219 22:36:33.266784 tst ping_idle_ping.py: using BVCI 17220 22:36:33.379207 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:33.390282 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:33.401407 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:33.412910 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:33.424478 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:33.435991 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:33.447744 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:33.459311 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:36:33.574456 tst ping_idle_ping.py:24: start network... 22:36:33.775409 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:36:34.244115 run create_hlr_db(pid=22431): Launched 22:36:34.359277 bus /gobi_6: Setting Powered False 22:36:35.420178 run create_hlr_db(pid=22431): Terminated: ok {rc=0} 22:36:35.860154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22433): Launched 22:36:36.180775 run osmo-hlr_10.42.42.2(pid=22434): Launched 22:36:36.303072 run osmo-stp_10.42.42.5: Starting osmo-stp 22:36:36.855782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22436): Launched 22:36:37.176079 run osmo-stp_10.42.42.5(pid=22437): Launched 22:36:37.298324 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:36:37.858437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22439): Launched 22:36:37.981471 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:36:38.252140 run patchelf(pid=22440): Launched 22:36:38.430648 run osmo-stp_10.42.42.5(pid=22437): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22437)] 22:36:38.567607 run osmo-stp_10.42.42.5(pid=22437): stdout: | (launched: 2022-12-08_22:36:37.117818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:38.705446 run osmo-stp_10.42.42.5(pid=22437): stderr: | 20221208223637309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223637309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223637309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223637310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223637312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223637312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223637312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:38.843283 run osmo-stp_10.42.42.5(pid=22437): stdout: | (launched: 2022-12-08_22:36:37.117818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:38.975717 run osmo-stp_10.42.42.5(pid=22437): stderr: | 20221208223637309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223637309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223637309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223637310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223637312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223637312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223637312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:39.132070 run patchelf(pid=22440): Terminating (SIGINT) 22:36:39.312547 run patchelf(pid=22440): Terminated: ok {rc=0} 22:36:39.442686 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22437): Process ended prematurely: osmo-stp_10.42.42.5(pid=22437) [trial-2350↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22437)] [trial-2350↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 22:36:39.452323 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:36:39.481210 run osmo-hlr_10.42.42.2(pid=22434): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22434)] 22:36:39.533352 run osmo-hlr_10.42.42.2(pid=22434): stdout: | (launched: 2022-12-08_22:36:36.122524) 22:36:39.586736 run osmo-hlr_10.42.42.2(pid=22434): stderr: | 20221208223636319 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223636319 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223636319 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223636319 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223636319 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223636319 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223636331 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223636339 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223636340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223636340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:36:39.640219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22433): Terminating (SIGTERM) 22:36:39.682984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22436): Terminating (SIGTERM) 22:36:39.726185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22439): Terminating (SIGTERM) 22:36:39.769356 --- ParallelTerminationStrategy: PID 22433 died... 22:36:39.789836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22433): Terminated: ok {rc=0} 22:36:39.837468 --- ParallelTerminationStrategy: PID 22436 died... 22:36:39.857561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22436): Terminated: ok {rc=0} 22:36:39.904662 --- ParallelTerminationStrategy: PID 22439 died... 22:36:39.924782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22439): Terminated: ok {rc=0} 22:36:40.014832 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:36:41.321441 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:36:41.328875 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:36:41.362766 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:36:41.398112 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:36:41.452265 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:36:41.485584 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:36:41.520742 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:36:42.078946 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2350 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:36:42.084138 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:36:42.095777 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:36:42.166444 tst switch_tch_pdch.py: using LAC 17220 22:36:42.293081 tst switch_tch_pdch.py: using RAC 135 22:36:42.418303 tst switch_tch_pdch.py: using CellId 17220 22:36:42.545219 tst switch_tch_pdch.py: using BVCI 17221 22:36:42.655014 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:36:42.666208 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:36:42.677137 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:36:42.688251 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:36:42.699426 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:36:42.710483 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:36:42.721857 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:36:42.732932 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:36:42.850643 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:36:42.975747 tst switch_tch_pdch.py:51: start network... 22:36:43.190227 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:36:43.683820 run create_hlr_db(pid=22445): Launched 22:36:43.812652 bus /gobi_6: Setting Powered False 22:36:44.875980 run create_hlr_db(pid=22445): Terminated: ok {rc=0} 22:36:45.319662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22447): Launched 22:36:45.638931 run osmo-hlr_10.42.42.2(pid=22448): Launched 22:36:45.759981 run osmo-stp_10.42.42.5: Starting osmo-stp 22:36:46.416657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22450): Launched 22:36:46.741716 run osmo-stp_10.42.42.5(pid=22451): Launched 22:36:46.972673 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:36:47.662196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22453): Launched 22:36:47.783636 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:36:48.052425 run patchelf(pid=22454): Launched 22:36:48.229785 run osmo-stp_10.42.42.5(pid=22451): ERR: Terminated: ERROR {rc=1} [trial-2350↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22451)] 22:36:48.365721 run osmo-stp_10.42.42.5(pid=22451): stdout: | (launched: 2022-12-08_22:36:46.682872) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:48.502862 run osmo-stp_10.42.42.5(pid=22451): stderr: | 20221208223647019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223647019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223647019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223647019 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223647020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223647020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223647020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:48.640242 run osmo-stp_10.42.42.5(pid=22451): stdout: | (launched: 2022-12-08_22:36:46.682872) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:48.771202 run osmo-stp_10.42.42.5(pid=22451): stderr: | 20221208223647019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223647019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223647019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223647019 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223647020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223647020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223647020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:48.926773 run patchelf(pid=22454): Terminating (SIGINT) 22:36:49.105935 run patchelf(pid=22454): Terminated: ok {rc=0} 22:36:49.234615 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22451): Process ended prematurely: osmo-stp_10.42.42.5(pid=22451) [trial-2350↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22451)] [trial-2350↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:36:49.244215 tst switch_tch_pdch.py:54: Test FAILED (7.2 sec) 22:36:49.272779 run osmo-hlr_10.42.42.2(pid=22448): ERR: Terminated: ERROR {rc=237} [trial-2350↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22448)] 22:36:49.323509 run osmo-hlr_10.42.42.2(pid=22448): stdout: | (launched: 2022-12-08_22:36:45.581283) 22:36:49.376004 run osmo-hlr_10.42.42.2(pid=22448): stderr: | 20221208223645780 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223645780 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223645780 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223645780 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223645780 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223645780 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223645793 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223645802 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223645802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223645802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:36:49.428817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22447): Terminating (SIGTERM) 22:36:49.471520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22450): Terminating (SIGTERM) 22:36:49.514552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22453): Terminating (SIGTERM) 22:36:49.557483 --- ParallelTerminationStrategy: PID 22447 died... 22:36:49.577772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22447): Terminated: ok {rc=0} 22:36:49.624879 --- ParallelTerminationStrategy: PID 22450 died... 22:36:49.644699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22450): Terminated: ok {rc=0} 22:36:49.691602 --- ParallelTerminationStrategy: PID 22453 died... 22:36:49.711489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22453): Terminated: ok {rc=0} 22:36:49.801195 bus /gobi_0: Setting Powered False 22:36:50.901534 bus /gobi_0: Setting Powered False 22:36:52.018490 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 22:36:53.267413 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:36:53.274546 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 22:36:53.308134 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 22:36:53.343669 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 22:36:53.398602 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 22:36:53.431756 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 22:36:53.465815 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 22:36:54.021904 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2350 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 22:36:54.027046 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:36:54.038058 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 22:36:54.105439 tst switch_tch_pdch.py: using LAC 17221 22:36:54.230500 tst switch_tch_pdch.py: using RAC 136 22:36:54.355405 tst switch_tch_pdch.py: using CellId 17221 22:36:54.478946 tst switch_tch_pdch.py: using BVCI 17222 22:36:54.594717 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:36:54.606216 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:36:54.617446 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:36:54.628407 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:36:54.639509 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:36:54.650716 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:36:54.662211 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:36:54.673400 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:36:54.789556 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:36:54.908222 tst switch_tch_pdch.py:51: start network... 22:36:55.123348 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:36:55.590118 run create_hlr_db(pid=22458): Launched 22:36:55.719674 bus /gobi_6: Setting Powered False 22:36:56.782576 run create_hlr_db(pid=22458): Terminated: ok {rc=0} 22:36:57.183586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22460): Launched 22:36:57.482596 run osmo-hlr_10.42.42.2(pid=22461): Launched 22:36:57.598569 run osmo-stp_10.42.42.5: Starting osmo-stp 22:36:58.099512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22463): Launched 22:36:58.418801 run osmo-stp_10.42.42.5(pid=22464): Launched 22:36:58.540507 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:36:59.063865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22466): Launched 22:36:59.186354 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:36:59.455387 run patchelf(pid=22467): Launched 22:36:59.634191 run osmo-stp_10.42.42.5(pid=22464): ERR: Terminated: ERROR {rc=1} [trial-2350↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22464)] 22:36:59.769715 run osmo-stp_10.42.42.5(pid=22464): stdout: | (launched: 2022-12-08_22:36:58.361083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:59.907116 run osmo-stp_10.42.42.5(pid=22464): stderr: | 20221208223658551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223658551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223658551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223658552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223658554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223658554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223658554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:00.044436 run osmo-stp_10.42.42.5(pid=22464): stdout: | (launched: 2022-12-08_22:36:58.361083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:00.175450 run osmo-stp_10.42.42.5(pid=22464): stderr: | 20221208223658551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223658551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223658551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223658552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223658554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223658554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223658554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:00.330974 run patchelf(pid=22467): Terminating (SIGINT) 22:37:00.511399 run patchelf(pid=22467): Terminated: ok {rc=0} 22:37:00.641116 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22464): Process ended prematurely: osmo-stp_10.42.42.5(pid=22464) [trial-2350↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22464)] [trial-2350↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 22:37:00.650640 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 22:37:00.678769 run osmo-hlr_10.42.42.2(pid=22461): ERR: Terminated: ERROR {rc=237} [trial-2350↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22461)] 22:37:00.729282 run osmo-hlr_10.42.42.2(pid=22461): stdout: | (launched: 2022-12-08_22:36:57.427298) 22:37:00.781648 run osmo-hlr_10.42.42.2(pid=22461): stderr: | 20221208223657604 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223657604 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223657605 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223657605 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223657605 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223657605 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223657617 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223657625 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223657625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223657625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:37:00.834606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22460): Terminating (SIGTERM) 22:37:00.892384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22463): Terminating (SIGTERM) 22:37:00.944243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22466): Terminating (SIGTERM) 22:37:00.987333 --- ParallelTerminationStrategy: PID 22460 died... 22:37:01.007489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22460): Terminated: ok {rc=0} 22:37:01.054835 --- ParallelTerminationStrategy: PID 22463 died... 22:37:01.075227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22463): Terminated: ok {rc=0} 22:37:01.123273 --- ParallelTerminationStrategy: PID 22466 died... 22:37:01.143738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22466): Terminated: ok {rc=0} 22:37:01.233770 bus /gobi_0: Setting Powered False 22:37:02.334725 bus /gobi_0: Setting Powered False 22:37:03.450896 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 22:37:04.704302 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:37:04.709210 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 22:37:04.738517 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 22:37:04.745378 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 22:37:04.796466 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 22:37:04.825470 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 22:37:04.832096 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 22:37:05.370495 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 22:37:05.375651 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 22:37:05.386554 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:37:05.432591 tst mo_mt_sms.py: using LAC 17222 22:37:05.550500 tst mo_mt_sms.py: using RAC 137 22:37:05.668410 tst mo_mt_sms.py: using CellId 17222 22:37:05.787263 tst mo_mt_sms.py: using BVCI 17223 22:37:05.895505 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 22:37:06.013495 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 22:37:06.130487 tst mo_mt_sms.py:9: start nitb and bts... 22:37:06.346228 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:37:06.994559 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22471): Launched 22:37:07.312710 run osmo-nitb_10.42.42.2(pid=22472): Launched 22:37:07.489312 run osmo-nitb_10.42.42.2(pid=22472): ERR: Terminated: ERROR {rc=2} [trial-2350↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22472)] 22:37:07.633942 run osmo-nitb_10.42.42.2(pid=22472): stdout: | (launched: 2022-12-08_22:37:07.254912) 22:37:07.779250 run osmo-nitb_10.42.42.2(pid=22472): stderr: | (launched: 2022-12-08_22:37:07.302593) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:37:07.924419 run osmo-nitb_10.42.42.2(pid=22472): stdout: | (launched: 2022-12-08_22:37:07.254912) 22:37:08.063415 run osmo-nitb_10.42.42.2(pid=22472): stderr: | (launched: 2022-12-08_22:37:07.302593) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3c9519268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22472): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22472) [trial-2350↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22472)] 22:37:08.433356 tst osmo-nitb_10.42.42.2(pid=22472): stdout: | (launched: 2022-12-08_22:37:07.254912) 22:37:08.562807 tst osmo-nitb_10.42.42.2(pid=22472): stderr: | (launched: 2022-12-08_22:37:07.302593) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:37:08.714859 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=22472): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22472) [trial-2350↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22472)] [trial-2350↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 22:37:08.723816 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 22:37:08.730880 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22471): Terminating (SIGTERM) 22:37:08.943660 --- ParallelTerminationStrategy: PID 22471 died... 22:37:08.965524 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22471): Terminated: ok {rc=0} 22:37:09.055790 bus /sierra_3: Setting Powered False 22:37:10.157400 bus /sierra_3: Setting Powered False 22:37:11.277510 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 22:37:12.472557 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:37:12.476742 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 22:37:12.506664 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 22:37:12.533810 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 22:37:12.586316 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 22:37:12.615748 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 22:37:12.643092 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 22:37:13.192475 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 22:37:13.198462 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:13.209880 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:37:13.253257 tst mo_mt_sms.py: using LAC 17223 22:37:13.370095 tst mo_mt_sms.py: using RAC 138 22:37:13.488018 tst mo_mt_sms.py: using CellId 17223 22:37:13.608821 tst mo_mt_sms.py: using BVCI 17224 22:37:13.719448 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:13.730087 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:13.740637 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:13.751349 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:13.762103 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:13.772624 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 22:37:13.888378 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 22:37:14.006808 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:37:14.499366 run create_hlr_db(pid=22476): Launched 22:37:14.614479 bus /sierra_2: Setting Powered False 22:37:15.675504 run create_hlr_db(pid=22476): Terminated: ok {rc=0} 22:37:16.114657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22478): Launched 22:37:16.437725 run osmo-hlr_10.42.42.2(pid=22479): Launched 22:37:16.633806 run osmo-stp_10.42.42.5: Starting osmo-stp 22:37:17.347364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22481): Launched 22:37:17.645425 run osmo-stp_10.42.42.5(pid=22482): Launched 22:37:17.760098 run osmo-msc_10.42.42.6: Starting osmo-msc 22:37:18.305123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22484): Launched 22:37:18.604474 run osmo-msc_10.42.42.6(pid=22485): Launched 22:37:18.772001 run osmo-stp_10.42.42.5(pid=22482): ERR: Terminated: ERROR {rc=1} [trial-2350↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22482)] 22:37:18.907843 run osmo-stp_10.42.42.5(pid=22482): stdout: | (launched: 2022-12-08_22:37:17.591272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:19.045383 run osmo-stp_10.42.42.5(pid=22482): stderr: | 20221208223717764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223717765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223717765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223717765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223717766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223717766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223717766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:19.179985 run osmo-stp_10.42.42.5(pid=22482): stdout: | (launched: 2022-12-08_22:37:17.591272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:19.308116 run osmo-stp_10.42.42.5(pid=22482): stderr: | 20221208223717764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223717765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223717765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223717765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223717766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223717766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223717766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:19.461204 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=22482): Process ended prematurely: osmo-stp_10.42.42.5(pid=22482) [trial-2350↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22482)] [trial-2350↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 22:37:19.470172 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 22:37:19.498240 run osmo-hlr_10.42.42.2(pid=22479): ERR: Terminated: ERROR {rc=237} [trial-2350↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22479)] 22:37:19.549802 run osmo-hlr_10.42.42.2(pid=22479): stdout: | (launched: 2022-12-08_22:37:16.373961) 22:37:19.602822 run osmo-hlr_10.42.42.2(pid=22479): stderr: | 20221208223716748 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223716748 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223716748 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223716748 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223716748 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223716748 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223716774 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223716782 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223716782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223716782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:37:19.676480 run osmo-msc_10.42.42.6(pid=22485): ERR: Terminated: ERROR {rc=2} [trial-2350↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22485)] 22:37:19.728238 run osmo-msc_10.42.42.6(pid=22485): stdout: | (launched: 2022-12-08_22:37:18.549972) 22:37:19.781361 run osmo-msc_10.42.42.6(pid=22485): stderr: | 20221208223718822 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223718822 DLGLOBAL DEBUG validating counter group 0x7f3c1de56c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223718822 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223718822 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223718822 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223718823 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223718825 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223718825 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223718825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223718826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:37:19.834638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22478): Terminating (SIGTERM) 22:37:19.877241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22481): Terminating (SIGTERM) 22:37:19.919930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22484): Terminating (SIGTERM) 22:37:19.963132 --- ParallelTerminationStrategy: PID 22478 died... 22:37:19.983707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22478): Terminated: ok {rc=0} 22:37:20.031545 --- ParallelTerminationStrategy: PID 22481 died... 22:37:20.051564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22481): Terminated: ok {rc=0} 22:37:20.099434 --- ParallelTerminationStrategy: PID 22484 died... 22:37:20.119944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22484): Terminated: ok {rc=0} 22:37:20.210391 bus /sierra_3: Setting Powered False 22:37:21.312018 bus /sierra_3: Setting Powered False 22:37:22.429380 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 22:37:23.658525 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:37:23.662637 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 22:37:23.692570 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 22:37:23.699566 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 22:37:23.735580 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 22:37:23.765950 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 22:37:23.772868 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 22:37:24.289718 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2350 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 22:37:24.294555 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 22:37:24.305504 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:37:24.348740 tst assert_extension.py: using LAC 17224 22:37:24.466202 tst assert_extension.py: using RAC 139 22:37:24.587138 tst assert_extension.py: using CellId 17224 22:37:24.714981 tst assert_extension.py: using BVCI 17225 22:37:24.830544 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 22:37:24.943654 tst assert_extension.py:10: start nitb and bts... 22:37:25.143575 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:37:25.754685 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22490): Launched 22:37:26.053521 run osmo-nitb_10.42.42.2(pid=22491): Launched 22:37:26.220742 run osmo-nitb_10.42.42.2(pid=22491): ERR: Terminated: ERROR {rc=2} [trial-2350↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22491)] 22:37:26.356184 run osmo-nitb_10.42.42.2(pid=22491): stdout: | (launched: 2022-12-08_22:37:25.998629) 22:37:26.493335 run osmo-nitb_10.42.42.2(pid=22491): stderr: | (launched: 2022-12-08_22:37:26.043019) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:37:26.630725 run osmo-nitb_10.42.42.2(pid=22491): stdout: | (launched: 2022-12-08_22:37:25.998629) 22:37:26.761957 run osmo-nitb_10.42.42.2(pid=22491): stderr: | (launched: 2022-12-08_22:37:26.043019) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3c9519268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22491): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22491) [trial-2350↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22491)] 22:37:27.166723 tst osmo-nitb_10.42.42.2(pid=22491): stdout: | (launched: 2022-12-08_22:37:25.998629) 22:37:27.287940 tst osmo-nitb_10.42.42.2(pid=22491): stderr: | (launched: 2022-12-08_22:37:26.043019) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:37:27.430393 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=22491): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22491) [trial-2350↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22491)] [trial-2350↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 22:37:27.438843 tst assert_extension.py:12: Test FAILED (3.1 sec) 22:37:27.445681 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22490): Terminating (SIGTERM) 22:37:27.657956 --- ParallelTerminationStrategy: PID 22490 died... 22:37:27.679520 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22490): Terminated: ok {rc=0} 22:37:27.768552 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 22:37:28.943899 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:37:28.948348 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 22:37:28.977910 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 22:37:29.005466 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 22:37:29.039432 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 22:37:29.069222 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 22:37:29.096701 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 22:37:29.628544 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2350 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 22:37:29.633930 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:29.645144 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:37:29.688551 tst assert_extension.py: using LAC 17225 22:37:29.808050 tst assert_extension.py: using RAC 140 22:37:29.927390 tst assert_extension.py: using CellId 17225 22:37:30.045057 tst assert_extension.py: using BVCI 17226 22:37:30.154150 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:30.165049 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:30.175760 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:30.186499 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:30.197234 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:30.208115 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 22:37:30.321529 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:37:30.784402 run create_hlr_db(pid=22495): Launched 22:37:30.909193 bus /sierra_2: Setting Powered False 22:37:31.972182 run create_hlr_db(pid=22495): Terminated: ok {rc=0} 22:37:32.430017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22497): Launched 22:37:32.753080 run osmo-hlr_10.42.42.2(pid=22498): Launched 22:37:32.874141 run osmo-stp_10.42.42.5: Starting osmo-stp 22:37:33.426060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22500): Launched 22:37:33.745989 run osmo-stp_10.42.42.5(pid=22501): Launched 22:37:33.867792 run osmo-msc_10.42.42.6: Starting osmo-msc 22:37:34.443940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22503): Launched 22:37:34.763079 run osmo-msc_10.42.42.6(pid=22504): Launched 22:37:34.940064 run osmo-stp_10.42.42.5(pid=22501): ERR: Terminated: ERROR {rc=1} [trial-2350↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22501)] 22:37:35.079389 run osmo-stp_10.42.42.5(pid=22501): stdout: | (launched: 2022-12-08_22:37:33.688047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:35.214135 run osmo-stp_10.42.42.5(pid=22501): stderr: | 20221208223733878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223733879 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223733879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223733879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223733880 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223733880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223733880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:35.347486 run osmo-stp_10.42.42.5(pid=22501): stdout: | (launched: 2022-12-08_22:37:33.688047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:35.474905 run osmo-stp_10.42.42.5(pid=22501): stderr: | 20221208223733878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223733879 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223733879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223733879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223733880 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223733880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223733880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:35.627991 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=22501): Process ended prematurely: osmo-stp_10.42.42.5(pid=22501) [trial-2350↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22501)] [trial-2350↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 22:37:35.636791 tst assert_extension.py:17: Test FAILED (6.0 sec) 22:37:35.665123 run osmo-hlr_10.42.42.2(pid=22498): ERR: Terminated: ERROR {rc=237} [trial-2350↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22498)] 22:37:35.716307 run osmo-hlr_10.42.42.2(pid=22498): stdout: | (launched: 2022-12-08_22:37:32.695082) 22:37:35.771483 run osmo-hlr_10.42.42.2(pid=22498): stderr: | 20221208223732893 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223732893 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223732893 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223732893 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223732893 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223732893 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223732905 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223732913 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223732913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223732913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:37:35.841845 run osmo-msc_10.42.42.6(pid=22504): ERR: Terminated: ERROR {rc=2} [trial-2350↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22504)] 22:37:35.890114 run osmo-msc_10.42.42.6(pid=22504): stdout: | (launched: 2022-12-08_22:37:34.704801) 22:37:35.940852 run osmo-msc_10.42.42.6(pid=22504): stderr: | 20221208223735024 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223735024 DLGLOBAL DEBUG validating counter group 0x7f4330479c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223735025 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223735025 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223735025 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223735025 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223735027 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223735027 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223735027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223735027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:37:35.991295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22497): Terminating (SIGTERM) 22:37:36.031610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22500): Terminating (SIGTERM) 22:37:36.072041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22503): Terminating (SIGTERM) 22:37:36.112598 --- ParallelTerminationStrategy: PID 22497 died... 22:37:36.131872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22497): Terminated: ok {rc=0} 22:37:36.177205 --- ParallelTerminationStrategy: PID 22500 died... 22:37:36.196000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22500): Terminated: ok {rc=0} 22:37:36.241462 --- ParallelTerminationStrategy: PID 22503 died... 22:37:36.260255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22503): Terminated: ok {rc=0} 22:37:36.345191 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:37:37.555761 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:37:37.562885 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:37:37.593351 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:37:37.620566 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:37:37.674335 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:37:37.704685 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:37:37.731970 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:37:38.282736 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:37:38.335909 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:38.347849 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:37:38.414234 tst mo_mt_call.py: using LAC 17226 22:37:38.542246 tst mo_mt_call.py: using RAC 141 22:37:38.672006 tst mo_mt_call.py: using CellId 17226 22:37:38.802501 tst mo_mt_call.py: using BVCI 17227 22:37:38.921783 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:38.933461 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:38.944929 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:38.956628 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:38.968364 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:38.980086 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:37:39.097631 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:37:39.215510 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:37:39.720776 run create_hlr_db(pid=22511): Launched 22:37:39.852213 bus /sierra_2: Setting Powered False 22:37:40.915786 run create_hlr_db(pid=22511): Terminated: ok {rc=0} 22:37:41.350199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22513): Launched 22:37:41.655028 run osmo-hlr_10.42.42.2(pid=22514): Launched 22:37:41.773525 run osmo-stp_10.42.42.5: Starting osmo-stp 22:37:42.303017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22516): Launched 22:37:42.628463 run osmo-stp_10.42.42.5(pid=22517): Launched 22:37:42.751429 run osmo-msc_10.42.42.6: Starting osmo-msc 22:37:43.337215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22519): Launched 22:37:43.660753 run osmo-msc_10.42.42.6(pid=22520): Launched 22:37:43.841138 run osmo-stp_10.42.42.5(pid=22517): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22517)] 22:37:43.979184 run osmo-stp_10.42.42.5(pid=22517): stdout: | (launched: 2022-12-08_22:37:42.569818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:44.116875 run osmo-stp_10.42.42.5(pid=22517): stderr: | 20221208223742763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223742763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223742764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223742764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223742765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223742765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223742765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:44.253136 run osmo-stp_10.42.42.5(pid=22517): stdout: | (launched: 2022-12-08_22:37:42.569818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:44.382860 run osmo-stp_10.42.42.5(pid=22517): stderr: | 20221208223742763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223742763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223742764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223742764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223742765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223742765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223742765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:44.537968 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22517): Process ended prematurely: osmo-stp_10.42.42.5(pid=22517) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22517)] [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:37:44.547461 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:37:44.575798 run osmo-hlr_10.42.42.2(pid=22514): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22514)] 22:37:44.626702 run osmo-hlr_10.42.42.2(pid=22514): stdout: | (launched: 2022-12-08_22:37:41.599343) 22:37:44.679542 run osmo-hlr_10.42.42.2(pid=22514): stderr: | 20221208223741775 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223741775 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223741775 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223741775 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223741775 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223741775 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223741786 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223741795 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223741795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223741795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:37:44.753074 run osmo-msc_10.42.42.6(pid=22520): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22520)] 22:37:44.803877 run osmo-msc_10.42.42.6(pid=22520): stdout: | (launched: 2022-12-08_22:37:43.601988) 22:37:44.856529 run osmo-msc_10.42.42.6(pid=22520): stderr: | 20221208223743927 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223743928 DLGLOBAL DEBUG validating counter group 0x7f004d10ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223743928 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223743928 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223743928 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223743928 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223743930 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223743930 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223743930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223743930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:37:44.909222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22513): Terminating (SIGTERM) 22:37:44.951480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22516): Terminating (SIGTERM) 22:37:44.993812 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22519): Terminating (SIGTERM) 22:37:45.036240 --- ParallelTerminationStrategy: PID 22513 died... 22:37:45.056117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22513): Terminated: ok {rc=0} 22:37:45.103014 --- ParallelTerminationStrategy: PID 22516 died... 22:37:45.122889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22516): Terminated: ok {rc=0} 22:37:45.169858 --- ParallelTerminationStrategy: PID 22519 died... 22:37:45.189693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22519): Terminated: ok {rc=0} 22:37:45.278350 bus /sierra_3: Setting Powered False 22:37:46.385262 bus /sierra_3: Setting Powered False 22:37:47.511599 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:37:48.662433 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:48.675084 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:37:48.742211 tst mo_mt_call_osmux.py: using LAC 17227 22:37:48.871567 tst mo_mt_call_osmux.py: using RAC 142 22:37:49.001025 tst mo_mt_call_osmux.py: using CellId 17227 22:37:49.128385 tst mo_mt_call_osmux.py: using BVCI 17228 22:37:49.248443 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:49.260171 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:49.271670 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:49.283150 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:49.294738 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:49.306213 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:37:49.424917 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:37:49.541512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:37:50.047274 run create_hlr_db(pid=22522): Launched 22:37:50.178965 bus /sierra_2: Setting Powered False 22:37:51.243697 run create_hlr_db(pid=22522): Terminated: ok {rc=0} 22:37:51.679185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22524): Launched 22:37:51.984673 run osmo-hlr_10.42.42.2(pid=22525): Launched 22:37:52.100788 run osmo-stp_10.42.42.5: Starting osmo-stp 22:37:52.642410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22527): Launched 22:37:52.946303 run osmo-stp_10.42.42.5(pid=22528): Launched 22:37:53.062691 run osmo-msc_10.42.42.6: Starting osmo-msc 22:37:53.616428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22530): Launched 22:37:53.922181 run osmo-msc_10.42.42.6(pid=22531): Launched 22:37:54.093353 run osmo-stp_10.42.42.5(pid=22528): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22528)] 22:37:54.223176 run osmo-stp_10.42.42.5(pid=22528): stdout: | (launched: 2022-12-08_22:37:52.890731) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:54.353351 run osmo-stp_10.42.42.5(pid=22528): stderr: | 20221208223753061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223753061 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223753061 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223753062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223753062 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223753062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223753062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:54.481192 run osmo-stp_10.42.42.5(pid=22528): stdout: | (launched: 2022-12-08_22:37:52.890731) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:54.602824 run osmo-stp_10.42.42.5(pid=22528): stderr: | 20221208223753061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223753061 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223753061 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223753062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223753062 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223753062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223753062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:54.748527 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22528): Process ended prematurely: osmo-stp_10.42.42.5(pid=22528) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22528)] [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:37:54.757414 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:37:54.784759 run osmo-hlr_10.42.42.2(pid=22525): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22525)] 22:37:54.834053 run osmo-hlr_10.42.42.2(pid=22525): stdout: | (launched: 2022-12-08_22:37:51.928532) 22:37:54.885340 run osmo-hlr_10.42.42.2(pid=22525): stderr: | 20221208223752107 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223752107 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223752107 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223752107 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223752107 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223752107 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223752119 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223752127 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223752127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223752127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:37:54.955947 run osmo-msc_10.42.42.6(pid=22531): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22531)] 22:37:55.004685 run osmo-msc_10.42.42.6(pid=22531): stdout: | (launched: 2022-12-08_22:37:53.866366) 22:37:55.055023 run osmo-msc_10.42.42.6(pid=22531): stderr: | 20221208223754135 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223754135 DLGLOBAL DEBUG validating counter group 0x7fc68f7b9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223754135 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223754135 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223754136 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223754136 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223754138 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223754138 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223754138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223754138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:37:55.105907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22524): Terminating (SIGTERM) 22:37:55.146653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22527): Terminating (SIGTERM) 22:37:55.187558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22530): Terminating (SIGTERM) 22:37:55.228343 --- ParallelTerminationStrategy: PID 22524 died... 22:37:55.247801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22524): Terminated: ok {rc=0} 22:37:55.293621 --- ParallelTerminationStrategy: PID 22527 died... 22:37:55.312398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22527): Terminated: ok {rc=0} 22:37:55.357824 --- ParallelTerminationStrategy: PID 22530 died... 22:37:55.376769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22530): Terminated: ok {rc=0} 22:37:55.462028 bus /sierra_3: Setting Powered False 22:37:56.560520 bus /sierra_3: Setting Powered False 22:37:57.679916 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:37:58.924603 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:37:58.931179 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:37:58.960923 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:37:58.987117 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:37:59.039209 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:37:59.068903 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:37:59.095512 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:37:59.650267 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:37:59.701730 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:37:59.712849 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:37:59.775837 tst mo_mt_call.py: using LAC 17228 22:37:59.897516 tst mo_mt_call.py: using RAC 143 22:38:00.017850 tst mo_mt_call.py: using CellId 17228 22:38:00.136714 tst mo_mt_call.py: using BVCI 17229 22:38:00.248064 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:00.259200 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:00.270157 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:00.281955 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:00.293285 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:00.304411 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:38:00.416791 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:38:00.536715 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:38:01.072152 run create_hlr_db(pid=22536): Launched 22:38:01.264168 bus /sierra_2: Setting Powered False 22:38:02.336757 run create_hlr_db(pid=22536): Terminated: ok {rc=0} 22:38:02.910996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22670): Launched 22:38:03.303370 run osmo-hlr_10.42.42.2(pid=22702): Launched 22:38:03.583993 run osmo-stp_10.42.42.5: Starting osmo-stp 22:38:04.370182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22810): Launched 22:38:04.712272 run osmo-stp_10.42.42.5(pid=22811): Launched 22:38:04.961658 run osmo-msc_10.42.42.6: Starting osmo-msc 22:38:05.641569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22813): Launched 22:38:05.982136 run osmo-msc_10.42.42.6(pid=22814): Launched 22:38:06.353540 run osmo-stp_10.42.42.5(pid=22811): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22811)] 22:38:06.627967 run osmo-stp_10.42.42.5(pid=22811): stdout: | (launched: 2022-12-08_22:38:04.651016) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:06.791759 run osmo-stp_10.42.42.5(pid=22811): stderr: | 20221208223804949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223804949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223804950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223804950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223804951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223804951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223804951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:06.929303 run osmo-stp_10.42.42.5(pid=22811): stdout: | (launched: 2022-12-08_22:38:04.651016) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:07.063717 run osmo-stp_10.42.42.5(pid=22811): stderr: | 20221208223804949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223804949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223804950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223804950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223804951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223804951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223804951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:07.222385 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22811): Process ended prematurely: osmo-stp_10.42.42.5(pid=22811) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22811)] [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:38:07.232925 tst mo_mt_call.py:8: Test FAILED (7.6 sec) 22:38:07.262932 run osmo-hlr_10.42.42.2(pid=22702): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22702)] 22:38:07.315257 run osmo-hlr_10.42.42.2(pid=22702): stdout: | (launched: 2022-12-08_22:38:03.231946) 22:38:07.369641 run osmo-hlr_10.42.42.2(pid=22702): stderr: | 20221208223803588 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223803588 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223803588 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223803588 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223803588 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223803588 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223803610 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223803622 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223803622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223803622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:38:07.445175 run osmo-msc_10.42.42.6(pid=22814): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22814)] 22:38:07.498466 run osmo-msc_10.42.42.6(pid=22814): stdout: | (launched: 2022-12-08_22:38:05.920548) 22:38:07.552751 run osmo-msc_10.42.42.6(pid=22814): stderr: | 20221208223806411 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223806411 DLGLOBAL DEBUG validating counter group 0x7f1104595c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223806411 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223806411 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223806412 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223806412 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223806422 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223806422 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223806423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223806423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:38:07.607195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22670): Terminating (SIGTERM) 22:38:07.651332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22810): Terminating (SIGTERM) 22:38:07.697082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22813): Terminating (SIGTERM) 22:38:07.743459 --- ParallelTerminationStrategy: PID 22670 died... 22:38:07.764497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22670): Terminated: ok {rc=0} 22:38:07.814183 --- ParallelTerminationStrategy: PID 22810 died... 22:38:07.835114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22810): Terminated: ok {rc=0} 22:38:07.884129 --- ParallelTerminationStrategy: PID 22813 died... 22:38:07.905169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22813): Terminated: ok {rc=0} 22:38:07.997436 bus /sierra_3: Setting Powered False 22:38:09.100347 bus /sierra_3: Setting Powered False 22:38:10.222968 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:38:11.375784 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:11.388722 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:38:11.457855 tst mo_mt_call_osmux.py: using LAC 17229 22:38:11.584254 tst mo_mt_call_osmux.py: using RAC 144 22:38:11.708076 tst mo_mt_call_osmux.py: using CellId 17229 22:38:11.836101 tst mo_mt_call_osmux.py: using BVCI 17230 22:38:11.953172 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:11.965524 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:11.977835 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:11.992096 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:12.005937 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:12.018182 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:38:12.140220 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:38:12.262353 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:38:12.757398 run create_hlr_db(pid=22818): Launched 22:38:12.914817 bus /sierra_2: Setting Powered False 22:38:13.982207 run create_hlr_db(pid=22818): Terminated: ok {rc=0} 22:38:14.454627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22820): Launched 22:38:14.808511 run osmo-hlr_10.42.42.2(pid=22821): Launched 22:38:15.060005 run osmo-stp_10.42.42.5: Starting osmo-stp 22:38:15.743214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22823): Launched 22:38:16.129732 run osmo-stp_10.42.42.5(pid=22824): Launched 22:38:16.439433 run osmo-msc_10.42.42.6: Starting osmo-msc 22:38:17.093743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22826): Launched 22:38:17.417483 run osmo-msc_10.42.42.6(pid=22827): Launched 22:38:17.767074 run osmo-stp_10.42.42.5(pid=22824): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22824)] 22:38:18.024244 run osmo-stp_10.42.42.5(pid=22824): stdout: | (launched: 2022-12-08_22:38:16.063329) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:18.218902 run osmo-stp_10.42.42.5(pid=22824): stderr: | 20221208223816315 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223816315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223816316 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223816316 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223816323 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223816323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223816323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:18.351155 run osmo-stp_10.42.42.5(pid=22824): stdout: | (launched: 2022-12-08_22:38:16.063329) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:18.476357 run osmo-stp_10.42.42.5(pid=22824): stderr: | 20221208223816315 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223816315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223816316 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223816316 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223816323 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223816323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223816323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:18.626374 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22824): Process ended prematurely: osmo-stp_10.42.42.5(pid=22824) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22824)] [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:38:18.635667 tst mo_mt_call_osmux.py:8: Test FAILED (7.3 sec) 22:38:18.666101 run osmo-hlr_10.42.42.2(pid=22821): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22821)] 22:38:18.716792 run osmo-hlr_10.42.42.2(pid=22821): stdout: | (launched: 2022-12-08_22:38:14.741251) 22:38:18.772478 run osmo-hlr_10.42.42.2(pid=22821): stderr: | 20221208223815056 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223815056 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223815056 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223815056 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223815056 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223815061 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223815075 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223815091 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223815092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223815092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:38:18.847643 run osmo-msc_10.42.42.6(pid=22827): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22827)] 22:38:18.898772 run osmo-msc_10.42.42.6(pid=22827): stdout: | (launched: 2022-12-08_22:38:17.356613) 22:38:18.951296 run osmo-msc_10.42.42.6(pid=22827): stderr: | 20221208223817942 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223817942 DLGLOBAL DEBUG validating counter group 0x7fa03801ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223817943 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223817943 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223817943 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223817943 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223817953 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223817953 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223817953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223817954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:38:19.004666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22820): Terminating (SIGTERM) 22:38:19.048679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22823): Terminating (SIGTERM) 22:38:19.094589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22826): Terminating (SIGTERM) 22:38:19.140013 --- ParallelTerminationStrategy: PID 22820 died... 22:38:19.160668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22820): Terminated: ok {rc=0} 22:38:19.210865 --- ParallelTerminationStrategy: PID 22823 died... 22:38:19.231049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22823): Terminated: ok {rc=0} 22:38:19.279801 --- ParallelTerminationStrategy: PID 22826 died... 22:38:19.300226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22826): Terminated: ok {rc=0} 22:38:19.390546 bus /sierra_3: Setting Powered False 22:38:20.492844 bus /sierra_3: Setting Powered False 22:38:21.614535 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:38:22.866712 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:38:22.873846 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:38:22.908020 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:38:22.938357 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:38:22.992011 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:38:23.023302 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:38:23.051821 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:38:23.601937 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:38:23.655837 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:23.668938 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:38:23.738439 tst mo_mt_call.py: using LAC 17230 22:38:23.864643 tst mo_mt_call.py: using RAC 145 22:38:23.990869 tst mo_mt_call.py: using CellId 17230 22:38:24.115131 tst mo_mt_call.py: using BVCI 17231 22:38:24.233224 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:24.245889 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:24.257994 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:24.271926 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:24.285450 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:24.297935 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:38:24.421399 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:38:24.542649 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:38:25.034916 run create_hlr_db(pid=22832): Launched 22:38:25.200775 bus /sierra_2: Setting Powered False 22:38:26.262427 run create_hlr_db(pid=22832): Terminated: ok {rc=0} 22:38:26.687721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22835): Launched 22:38:26.993603 run osmo-hlr_10.42.42.2(pid=22836): Launched 22:38:27.110499 run osmo-stp_10.42.42.5: Starting osmo-stp 22:38:27.649684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22838): Launched 22:38:27.955731 run osmo-stp_10.42.42.5(pid=22839): Launched 22:38:28.071589 run osmo-msc_10.42.42.6: Starting osmo-msc 22:38:28.626922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22841): Launched 22:38:28.933087 run osmo-msc_10.42.42.6(pid=22842): Launched 22:38:29.104378 run osmo-stp_10.42.42.5(pid=22839): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22839)] 22:38:29.235242 run osmo-stp_10.42.42.5(pid=22839): stdout: | (launched: 2022-12-08_22:38:27.899653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:29.365709 run osmo-stp_10.42.42.5(pid=22839): stderr: | 20221208223828068 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223828068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223828069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223828069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223828070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223828070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223828070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:29.493958 run osmo-stp_10.42.42.5(pid=22839): stdout: | (launched: 2022-12-08_22:38:27.899653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:29.616097 run osmo-stp_10.42.42.5(pid=22839): stderr: | 20221208223828068 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223828068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223828069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223828069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223828070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223828070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223828070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:29.762075 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22839): Process ended prematurely: osmo-stp_10.42.42.5(pid=22839) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22839)] [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:38:29.771085 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:38:29.798149 run osmo-hlr_10.42.42.2(pid=22836): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22836)] 22:38:29.847528 run osmo-hlr_10.42.42.2(pid=22836): stdout: | (launched: 2022-12-08_22:38:26.937770) 22:38:29.898409 run osmo-hlr_10.42.42.2(pid=22836): stderr: | 20221208223827114 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223827115 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223827115 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223827115 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223827115 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223827115 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223827128 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223827137 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223827137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223827137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:38:29.969621 run osmo-msc_10.42.42.6(pid=22842): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22842)] 22:38:30.018364 run osmo-msc_10.42.42.6(pid=22842): stdout: | (launched: 2022-12-08_22:38:28.877288) 22:38:30.069073 run osmo-msc_10.42.42.6(pid=22842): stderr: | 20221208223829147 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223829148 DLGLOBAL DEBUG validating counter group 0x7f9830853c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223829148 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223829148 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223829148 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223829148 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223829150 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223829150 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223829150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223829151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:38:30.119806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22835): Terminating (SIGTERM) 22:38:30.160654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22838): Terminating (SIGTERM) 22:38:30.201710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22841): Terminating (SIGTERM) 22:38:30.243056 --- ParallelTerminationStrategy: PID 22835 died... 22:38:30.262775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22835): Terminated: ok {rc=0} 22:38:30.308610 --- ParallelTerminationStrategy: PID 22838 died... 22:38:30.327677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22838): Terminated: ok {rc=0} 22:38:30.373170 --- ParallelTerminationStrategy: PID 22841 died... 22:38:30.392156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22841): Terminated: ok {rc=0} 22:38:30.477810 bus /sierra_3: Setting Powered False 22:38:31.572153 bus /sierra_3: Setting Powered False 22:38:32.685638 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:38:33.836004 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:33.848306 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:38:33.915558 tst mo_mt_call_osmux.py: using LAC 17231 22:38:34.038329 tst mo_mt_call_osmux.py: using RAC 146 22:38:34.160730 tst mo_mt_call_osmux.py: using CellId 17231 22:38:34.283571 tst mo_mt_call_osmux.py: using BVCI 17232 22:38:34.396723 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:34.407893 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:34.419030 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:34.430329 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:34.441712 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:34.452723 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:38:34.571599 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:38:34.687654 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:38:35.162378 run create_hlr_db(pid=22844): Launched 22:38:35.277986 bus /sierra_2: Setting Powered False 22:38:36.341081 run create_hlr_db(pid=22844): Terminated: ok {rc=0} 22:38:36.786785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22846): Launched 22:38:37.111810 run osmo-hlr_10.42.42.2(pid=22847): Launched 22:38:37.235435 run osmo-stp_10.42.42.5: Starting osmo-stp 22:38:37.794588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22849): Launched 22:38:38.120320 run osmo-stp_10.42.42.5(pid=22850): Launched 22:38:38.243956 run osmo-msc_10.42.42.6: Starting osmo-msc 22:38:38.834625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22852): Launched 22:38:39.159892 run osmo-msc_10.42.42.6(pid=22853): Launched 22:38:39.341208 run osmo-stp_10.42.42.5(pid=22850): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22850)] 22:38:39.479251 run osmo-stp_10.42.42.5(pid=22850): stdout: | (launched: 2022-12-08_22:38:38.061311) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:39.617897 run osmo-stp_10.42.42.5(pid=22850): stderr: | 20221208223838252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223838252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223838252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223838252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223838255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223838255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223838255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:39.754781 run osmo-stp_10.42.42.5(pid=22850): stdout: | (launched: 2022-12-08_22:38:38.061311) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:39.884556 run osmo-stp_10.42.42.5(pid=22850): stderr: | 20221208223838252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223838252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223838252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223838252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223838255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223838255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223838255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:40.039881 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22850): Process ended prematurely: osmo-stp_10.42.42.5(pid=22850) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22850)] [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:38:40.049384 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:38:40.077691 run osmo-hlr_10.42.42.2(pid=22847): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22847)] 22:38:40.129185 run osmo-hlr_10.42.42.2(pid=22847): stdout: | (launched: 2022-12-08_22:38:37.052889) 22:38:40.182112 run osmo-hlr_10.42.42.2(pid=22847): stderr: | 20221208223837252 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223837252 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223837252 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223837252 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223837252 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223837252 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223837264 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223837274 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223837274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223837274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:38:40.255622 run osmo-msc_10.42.42.6(pid=22853): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22853)] 22:38:40.306584 run osmo-msc_10.42.42.6(pid=22853): stdout: | (launched: 2022-12-08_22:38:39.100442) 22:38:40.360239 run osmo-msc_10.42.42.6(pid=22853): stderr: | 20221208223839423 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223839423 DLGLOBAL DEBUG validating counter group 0x7f52e4753c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223839423 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223839423 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223839423 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223839424 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223839425 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223839426 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223839426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223839426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:38:40.413454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22846): Terminating (SIGTERM) 22:38:40.455940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22849): Terminating (SIGTERM) 22:38:40.498442 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22852): Terminating (SIGTERM) 22:38:40.541311 --- ParallelTerminationStrategy: PID 22846 died... 22:38:40.561703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22846): Terminated: ok {rc=0} 22:38:40.609087 --- ParallelTerminationStrategy: PID 22849 died... 22:38:40.629102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22849): Terminated: ok {rc=0} 22:38:40.675890 --- ParallelTerminationStrategy: PID 22852 died... 22:38:40.696103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22852): Terminated: ok {rc=0} 22:38:40.783425 bus /sierra_3: Setting Powered False 22:38:41.883714 bus /sierra_3: Setting Powered False 22:38:43.001144 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 22:38:44.245107 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:38:44.251363 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 22:38:44.280253 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 22:38:44.307552 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 22:38:44.358726 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 22:38:44.387889 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 22:38:44.414447 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 22:38:44.965727 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 22:38:45.014735 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:45.025926 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:38:45.091092 tst mo_mt_call.py: using LAC 17232 22:38:45.222371 tst mo_mt_call.py: using RAC 147 22:38:45.357413 tst mo_mt_call.py: using CellId 17232 22:38:45.485665 tst mo_mt_call.py: using BVCI 17233 22:38:45.604938 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:45.616713 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:45.628416 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:45.640067 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:45.651664 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:45.663425 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:38:45.783066 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:38:45.922750 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:38:46.456464 run create_hlr_db(pid=22858): Launched 22:38:46.582708 bus /sierra_2: Setting Powered False 22:38:47.643448 run create_hlr_db(pid=22858): Terminated: ok {rc=0} 22:38:48.090112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22860): Launched 22:38:48.417385 run osmo-hlr_10.42.42.2(pid=22861): Launched 22:38:48.541621 run osmo-stp_10.42.42.5: Starting osmo-stp 22:38:49.102456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22864): Launched 22:38:49.428706 run osmo-stp_10.42.42.5(pid=22865): Launched 22:38:49.553288 run osmo-msc_10.42.42.6: Starting osmo-msc 22:38:50.142871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22867): Launched 22:38:50.470141 run osmo-msc_10.42.42.6(pid=22868): Launched 22:38:50.651522 run osmo-stp_10.42.42.5(pid=22865): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22865)] 22:38:50.790847 run osmo-stp_10.42.42.5(pid=22865): stdout: | (launched: 2022-12-08_22:38:49.369534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:50.929442 run osmo-stp_10.42.42.5(pid=22865): stderr: | 20221208223849565 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223849565 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223849566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223849566 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223849567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223849567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223849567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:51.066783 run osmo-stp_10.42.42.5(pid=22865): stdout: | (launched: 2022-12-08_22:38:49.369534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:51.196799 run osmo-stp_10.42.42.5(pid=22865): stderr: | 20221208223849565 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223849565 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223849566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223849566 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223849567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223849567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223849567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:51.352531 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22865): Process ended prematurely: osmo-stp_10.42.42.5(pid=22865) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22865)] [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 22:38:51.362378 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 22:38:51.390909 run osmo-hlr_10.42.42.2(pid=22861): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22861)] 22:38:51.442623 run osmo-hlr_10.42.42.2(pid=22861): stdout: | (launched: 2022-12-08_22:38:48.357952) 22:38:51.495892 run osmo-hlr_10.42.42.2(pid=22861): stderr: | 20221208223848557 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223848557 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223848557 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223848557 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223848557 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223848557 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223848569 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223848578 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223848578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223848578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:38:51.570421 run osmo-msc_10.42.42.6(pid=22868): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22868)] 22:38:51.621774 run osmo-msc_10.42.42.6(pid=22868): stdout: | (launched: 2022-12-08_22:38:50.410494) 22:38:51.674763 run osmo-msc_10.42.42.6(pid=22868): stderr: | 20221208223850731 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223850731 DLGLOBAL DEBUG validating counter group 0x7f729eb61c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223850732 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223850732 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223850732 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223850732 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223850734 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223850734 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223850734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223850734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:38:51.728151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22860): Terminating (SIGTERM) 22:38:51.771109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22864): Terminating (SIGTERM) 22:38:51.814052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22867): Terminating (SIGTERM) 22:38:51.857236 --- ParallelTerminationStrategy: PID 22860 died... 22:38:51.877500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22860): Terminated: ok {rc=0} 22:38:51.925091 --- ParallelTerminationStrategy: PID 22864 died... 22:38:51.945272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22864): Terminated: ok {rc=0} 22:38:51.992773 --- ParallelTerminationStrategy: PID 22867 died... 22:38:52.012879 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22867): Terminated: ok {rc=0} 22:38:52.102434 bus /sierra_3: Setting Powered False 22:38:53.203314 bus /sierra_3: Setting Powered False 22:38:54.321824 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 22:38:55.469886 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:55.481742 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:38:55.547435 tst mo_mt_call_osmux.py: using LAC 17233 22:38:55.668243 tst mo_mt_call_osmux.py: using RAC 148 22:38:55.792800 tst mo_mt_call_osmux.py: using CellId 17233 22:38:55.913490 tst mo_mt_call_osmux.py: using BVCI 17234 22:38:56.026756 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:56.038084 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:56.049434 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:56.060610 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:56.072096 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:56.083328 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:38:56.203659 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:38:56.320424 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:38:56.827725 run create_hlr_db(pid=22870): Launched 22:38:56.960190 bus /sierra_2: Setting Powered False 22:38:58.024022 run create_hlr_db(pid=22870): Terminated: ok {rc=0} 22:38:58.459645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22872): Launched 22:38:58.765134 run osmo-hlr_10.42.42.2(pid=22873): Launched 22:38:58.880912 run osmo-stp_10.42.42.5: Starting osmo-stp 22:38:59.420468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22875): Launched 22:38:59.725820 run osmo-stp_10.42.42.5(pid=22876): Launched 22:38:59.842452 run osmo-msc_10.42.42.6: Starting osmo-msc 22:39:00.396661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22878): Launched 22:39:00.702616 run osmo-msc_10.42.42.6(pid=22879): Launched 22:39:00.930920 run osmo-stp_10.42.42.5(pid=22876): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22876)] 22:39:01.200780 run osmo-stp_10.42.42.5(pid=22876): stdout: | (launched: 2022-12-08_22:38:59.670296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:01.343193 run osmo-stp_10.42.42.5(pid=22876): stderr: | 20221208223859841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223859841 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223859841 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223859841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223859842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223859842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223859842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:01.484159 run osmo-stp_10.42.42.5(pid=22876): stdout: | (launched: 2022-12-08_22:38:59.670296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:01.621386 run osmo-stp_10.42.42.5(pid=22876): stderr: | 20221208223859841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223859841 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223859841 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223859841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223859842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223859842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223859842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:01.783990 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22876): Process ended prematurely: osmo-stp_10.42.42.5(pid=22876) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22876)] [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 22:39:01.794727 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 22:39:01.825906 run osmo-hlr_10.42.42.2(pid=22873): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22873)] 22:39:01.879840 run osmo-hlr_10.42.42.2(pid=22873): stdout: | (launched: 2022-12-08_22:38:58.709181) 22:39:01.935542 run osmo-hlr_10.42.42.2(pid=22873): stderr: | 20221208223858884 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223858884 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223858884 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223858884 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223858884 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223858884 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223858896 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223858905 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223858905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223858905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:39:02.011843 run osmo-msc_10.42.42.6(pid=22879): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22879)] 22:39:02.064505 run osmo-msc_10.42.42.6(pid=22879): stdout: | (launched: 2022-12-08_22:39:00.646903) 22:39:02.120432 run osmo-msc_10.42.42.6(pid=22879): stderr: | 20221208223900971 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223900972 DLGLOBAL DEBUG validating counter group 0x7f92b2e95c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223900972 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223900972 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223900972 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223900972 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223900974 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223900974 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223900974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223900975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:39:02.175933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22872): Terminating (SIGTERM) 22:39:02.219720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22875): Terminating (SIGTERM) 22:39:02.262523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22878): Terminating (SIGTERM) 22:39:02.305831 --- ParallelTerminationStrategy: PID 22872 died... 22:39:02.326534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22872): Terminated: ok {rc=0} 22:39:02.374470 --- ParallelTerminationStrategy: PID 22875 died... 22:39:02.394660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22875): Terminated: ok {rc=0} 22:39:02.442085 --- ParallelTerminationStrategy: PID 22878 died... 22:39:02.462435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22878): Terminated: ok {rc=0} 22:39:02.552102 bus /sierra_3: Setting Powered False 22:39:03.652654 bus /sierra_3: Setting Powered False 22:39:04.770319 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:39:06.014252 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:39:06.022554 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:39:06.051935 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:39:06.079739 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:39:06.133632 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:39:06.162802 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:39:06.188714 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:39:06.747059 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:39:06.799382 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:06.810959 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:39:06.877470 tst mo_mt_call.py: using LAC 17234 22:39:07.007586 tst mo_mt_call.py: using RAC 149 22:39:07.136038 tst mo_mt_call.py: using CellId 17234 22:39:07.258252 tst mo_mt_call.py: using BVCI 17235 22:39:07.369970 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:07.381144 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:07.392068 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:07.403256 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:07.414571 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:07.425785 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:39:07.546362 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:39:07.668258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:39:08.173916 run create_hlr_db(pid=22884): Launched 22:39:08.306996 bus /sierra_2: Setting Powered False 22:39:09.372100 run create_hlr_db(pid=22884): Terminated: ok {rc=0} 22:39:09.825288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22886): Launched 22:39:10.150556 run osmo-hlr_10.42.42.2(pid=22887): Launched 22:39:10.274025 run osmo-stp_10.42.42.5: Starting osmo-stp 22:39:10.839194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22889): Launched 22:39:11.164561 run osmo-stp_10.42.42.5(pid=22890): Launched 22:39:11.287990 run osmo-msc_10.42.42.6: Starting osmo-msc 22:39:11.878452 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22892): Launched 22:39:12.205349 run osmo-msc_10.42.42.6(pid=22893): Launched 22:39:12.387227 run osmo-stp_10.42.42.5(pid=22890): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22890)] 22:39:12.525273 run osmo-stp_10.42.42.5(pid=22890): stdout: | (launched: 2022-12-08_22:39:11.105362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:12.664764 run osmo-stp_10.42.42.5(pid=22890): stderr: | 20221208223911297 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223911297 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223911297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223911298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223911298 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223911298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223911298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:12.802136 run osmo-stp_10.42.42.5(pid=22890): stdout: | (launched: 2022-12-08_22:39:11.105362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:12.932316 run osmo-stp_10.42.42.5(pid=22890): stderr: | 20221208223911297 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223911297 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223911297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223911298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223911298 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223911298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223911298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:13.087806 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22890): Process ended prematurely: osmo-stp_10.42.42.5(pid=22890) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22890)] [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:39:13.097712 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:39:13.126259 run osmo-hlr_10.42.42.2(pid=22887): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22887)] 22:39:13.177413 run osmo-hlr_10.42.42.2(pid=22887): stdout: | (launched: 2022-12-08_22:39:10.091437) 22:39:13.230447 run osmo-hlr_10.42.42.2(pid=22887): stderr: | 20221208223910289 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223910289 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223910289 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223910289 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223910289 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223910289 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223910302 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223910310 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223910310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223910310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:39:13.304410 run osmo-msc_10.42.42.6(pid=22893): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22893)] 22:39:13.355119 run osmo-msc_10.42.42.6(pid=22893): stdout: | (launched: 2022-12-08_22:39:12.146008) 22:39:13.407476 run osmo-msc_10.42.42.6(pid=22893): stderr: | 20221208223912469 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223912469 DLGLOBAL DEBUG validating counter group 0x7fbcaf8cbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223912469 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223912469 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223912469 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223912469 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223912471 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223912471 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223912472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223912472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:39:13.460309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22886): Terminating (SIGTERM) 22:39:13.502871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22889): Terminating (SIGTERM) 22:39:13.545237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22892): Terminating (SIGTERM) 22:39:13.588421 --- ParallelTerminationStrategy: PID 22886 died... 22:39:13.608586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22886): Terminated: ok {rc=0} 22:39:13.655898 --- ParallelTerminationStrategy: PID 22889 died... 22:39:13.675737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22889): Terminated: ok {rc=0} 22:39:13.723001 --- ParallelTerminationStrategy: PID 22892 died... 22:39:13.743065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22892): Terminated: ok {rc=0} 22:39:13.832527 bus /sierra_3: Setting Powered False 22:39:14.933322 bus /sierra_3: Setting Powered False 22:39:16.052474 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:39:17.210433 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:17.223342 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:39:17.292745 tst mo_mt_call_osmux.py: using LAC 17235 22:39:17.415464 tst mo_mt_call_osmux.py: using RAC 150 22:39:17.537985 tst mo_mt_call_osmux.py: using CellId 17235 22:39:17.661661 tst mo_mt_call_osmux.py: using BVCI 17236 22:39:17.775553 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:17.786817 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:17.797987 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:17.809874 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:17.821711 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:17.833412 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:39:17.950914 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:39:18.066147 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:39:18.539827 run create_hlr_db(pid=22895): Launched 22:39:18.656565 bus /sierra_2: Setting Powered False 22:39:19.718371 run create_hlr_db(pid=22895): Terminated: ok {rc=0} 22:39:20.144426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22897): Launched 22:39:20.449725 run osmo-hlr_10.42.42.2(pid=22898): Launched 22:39:20.566895 run osmo-stp_10.42.42.5: Starting osmo-stp 22:39:21.105217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22900): Launched 22:39:21.409715 run osmo-stp_10.42.42.5(pid=22901): Launched 22:39:21.526006 run osmo-msc_10.42.42.6: Starting osmo-msc 22:39:22.078389 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22903): Launched 22:39:22.384599 run osmo-msc_10.42.42.6(pid=22904): Launched 22:39:22.555697 run osmo-stp_10.42.42.5(pid=22901): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22901)] 22:39:22.687056 run osmo-stp_10.42.42.5(pid=22901): stdout: | (launched: 2022-12-08_22:39:21.354280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:22.817149 run osmo-stp_10.42.42.5(pid=22901): stderr: | 20221208223921524 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223921525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223921525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223921525 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223921526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223921526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223921526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:22.944798 run osmo-stp_10.42.42.5(pid=22901): stdout: | (launched: 2022-12-08_22:39:21.354280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:23.066525 run osmo-stp_10.42.42.5(pid=22901): stderr: | 20221208223921524 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223921525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223921525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223921525 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223921526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223921526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223921526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:23.212401 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22901): Process ended prematurely: osmo-stp_10.42.42.5(pid=22901) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22901)] [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:39:23.221541 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:39:23.249266 run osmo-hlr_10.42.42.2(pid=22898): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22898)] 22:39:23.298421 run osmo-hlr_10.42.42.2(pid=22898): stdout: | (launched: 2022-12-08_22:39:20.393790) 22:39:23.349327 run osmo-hlr_10.42.42.2(pid=22898): stderr: | 20221208223920572 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223920572 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223920572 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223920572 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223920572 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223920572 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223920584 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223920593 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223920593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223920593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:39:23.420123 run osmo-msc_10.42.42.6(pid=22904): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22904)] 22:39:23.468867 run osmo-msc_10.42.42.6(pid=22904): stdout: | (launched: 2022-12-08_22:39:22.328366) 22:39:23.519528 run osmo-msc_10.42.42.6(pid=22904): stderr: | 20221208223922599 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223922599 DLGLOBAL DEBUG validating counter group 0x7ffbac235c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223922599 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223922599 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223922599 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223922600 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223922601 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223922602 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223922602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223922602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:39:23.570476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22897): Terminating (SIGTERM) 22:39:23.611460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22900): Terminating (SIGTERM) 22:39:23.652075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22903): Terminating (SIGTERM) 22:39:23.693275 --- ParallelTerminationStrategy: PID 22897 died... 22:39:23.712797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22897): Terminated: ok {rc=0} 22:39:23.758538 --- ParallelTerminationStrategy: PID 22900 died... 22:39:23.777762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22900): Terminated: ok {rc=0} 22:39:23.823725 --- ParallelTerminationStrategy: PID 22903 died... 22:39:23.842967 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22903): Terminated: ok {rc=0} 22:39:23.931648 bus /sierra_3: Setting Powered False 22:39:25.030843 bus /sierra_3: Setting Powered False 22:39:26.148047 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:39:27.398578 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:39:27.405485 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:39:27.435477 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:39:27.462646 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:39:27.514669 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:39:27.544210 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:39:27.571649 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:39:28.125880 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:39:28.177662 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:28.189687 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:39:28.257026 tst mo_mt_call.py: using LAC 17236 22:39:28.384765 tst mo_mt_call.py: using RAC 151 22:39:28.513197 tst mo_mt_call.py: using CellId 17236 22:39:28.641739 tst mo_mt_call.py: using BVCI 17237 22:39:28.762589 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:28.774498 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:28.786156 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:28.797845 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:28.809521 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:28.821244 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:39:28.940277 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:39:29.059343 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:39:29.564505 run create_hlr_db(pid=22910): Launched 22:39:29.697420 bus /sierra_2: Setting Powered False 22:39:30.762820 run create_hlr_db(pid=22910): Terminated: ok {rc=0} 22:39:31.217434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22912): Launched 22:39:31.558330 run osmo-hlr_10.42.42.2(pid=22913): Launched 22:39:31.757107 run osmo-stp_10.42.42.5: Starting osmo-stp 22:39:32.467157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22915): Launched 22:39:32.774160 run osmo-stp_10.42.42.5(pid=22916): Launched 22:39:32.890209 run osmo-msc_10.42.42.6: Starting osmo-msc 22:39:33.443256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22918): Launched 22:39:33.749314 run osmo-msc_10.42.42.6(pid=22919): Launched 22:39:33.920259 run osmo-stp_10.42.42.5(pid=22916): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22916)] 22:39:34.050705 run osmo-stp_10.42.42.5(pid=22916): stdout: | (launched: 2022-12-08_22:39:32.717646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:34.181616 run osmo-stp_10.42.42.5(pid=22916): stderr: | 20221208223932887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223932887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223932887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223932888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223932888 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223932888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223932888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:34.309973 run osmo-stp_10.42.42.5(pid=22916): stdout: | (launched: 2022-12-08_22:39:32.717646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:34.432085 run osmo-stp_10.42.42.5(pid=22916): stderr: | 20221208223932887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223932887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223932887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223932888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223932888 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223932888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223932888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:34.578385 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22916): Process ended prematurely: osmo-stp_10.42.42.5(pid=22916) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22916)] [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:39:34.587261 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 22:39:34.614550 run osmo-hlr_10.42.42.2(pid=22913): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22913)] 22:39:34.663860 run osmo-hlr_10.42.42.2(pid=22913): stdout: | (launched: 2022-12-08_22:39:31.485534) 22:39:34.714750 run osmo-hlr_10.42.42.2(pid=22913): stderr: | 20221208223931818 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223931818 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223931818 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223931818 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223931818 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223931818 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223931832 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223931842 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223931842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223931842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:39:34.786372 run osmo-msc_10.42.42.6(pid=22919): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22919)] 22:39:34.835633 run osmo-msc_10.42.42.6(pid=22919): stdout: | (launched: 2022-12-08_22:39:33.693254) 22:39:34.886371 run osmo-msc_10.42.42.6(pid=22919): stderr: | 20221208223933967 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223933967 DLGLOBAL DEBUG validating counter group 0x7ff1ebc75c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223933967 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223933967 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223933967 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223933967 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223933969 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223933970 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223933970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223933970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:39:34.937585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22912): Terminating (SIGTERM) 22:39:34.978241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22915): Terminating (SIGTERM) 22:39:35.018830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22918): Terminating (SIGTERM) 22:39:35.059881 --- ParallelTerminationStrategy: PID 22912 died... 22:39:35.079360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22912): Terminated: ok {rc=0} 22:39:35.125014 --- ParallelTerminationStrategy: PID 22915 died... 22:39:35.144073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22915): Terminated: ok {rc=0} 22:39:35.189703 --- ParallelTerminationStrategy: PID 22918 died... 22:39:35.208662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22918): Terminated: ok {rc=0} 22:39:35.296783 bus /sierra_3: Setting Powered False 22:39:36.397342 bus /sierra_3: Setting Powered False 22:39:37.514568 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:39:38.666957 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:38.679339 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:39:38.747494 tst mo_mt_call_osmux.py: using LAC 17237 22:39:38.876563 tst mo_mt_call_osmux.py: using RAC 152 22:39:39.005019 tst mo_mt_call_osmux.py: using CellId 17237 22:39:39.133476 tst mo_mt_call_osmux.py: using BVCI 17238 22:39:39.252531 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:39.264401 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:39.276186 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:39.287818 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:39.299564 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:39.311241 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:39:39.426719 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:39:39.546969 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:39:40.054017 run create_hlr_db(pid=22921): Launched 22:39:40.186823 bus /sierra_2: Setting Powered False 22:39:41.251379 run create_hlr_db(pid=22921): Terminated: ok {rc=0} 22:39:41.687523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22923): Launched 22:39:41.993110 run osmo-hlr_10.42.42.2(pid=22924): Launched 22:39:42.108662 run osmo-stp_10.42.42.5: Starting osmo-stp 22:39:42.652542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22926): Launched 22:39:42.959760 run osmo-stp_10.42.42.5(pid=22927): Launched 22:39:43.076040 run osmo-msc_10.42.42.6: Starting osmo-msc 22:39:43.628158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22929): Launched 22:39:43.933730 run osmo-msc_10.42.42.6(pid=22930): Launched 22:39:44.106222 run osmo-stp_10.42.42.5(pid=22927): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22927)] 22:39:44.237403 run osmo-stp_10.42.42.5(pid=22927): stdout: | (launched: 2022-12-08_22:39:42.904130) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:44.367732 run osmo-stp_10.42.42.5(pid=22927): stderr: | 20221208223943074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223943074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223943074 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223943075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223943075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223943075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223943075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:44.496533 run osmo-stp_10.42.42.5(pid=22927): stdout: | (launched: 2022-12-08_22:39:42.904130) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:44.619153 run osmo-stp_10.42.42.5(pid=22927): stderr: | 20221208223943074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223943074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223943074 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223943075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223943075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223943075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223943075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:44.765630 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22927): Process ended prematurely: osmo-stp_10.42.42.5(pid=22927) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22927)] [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:39:44.774429 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:39:44.801715 run osmo-hlr_10.42.42.2(pid=22924): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22924)] 22:39:44.851508 run osmo-hlr_10.42.42.2(pid=22924): stdout: | (launched: 2022-12-08_22:39:41.937324) 22:39:44.902480 run osmo-hlr_10.42.42.2(pid=22924): stderr: | 20221208223942112 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223942112 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223942112 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223942112 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223942112 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223942112 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223942125 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223942134 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223942134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223942134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:39:44.973386 run osmo-msc_10.42.42.6(pid=22930): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22930)] 22:39:45.022120 run osmo-msc_10.42.42.6(pid=22930): stdout: | (launched: 2022-12-08_22:39:43.877605) 22:39:45.072684 run osmo-msc_10.42.42.6(pid=22930): stderr: | 20221208223944146 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223944146 DLGLOBAL DEBUG validating counter group 0x7f78145a9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223944146 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223944146 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223944146 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223944146 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223944148 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223944149 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223944149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223944149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:39:45.123600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22923): Terminating (SIGTERM) 22:39:45.164398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22926): Terminating (SIGTERM) 22:39:45.205121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22929): Terminating (SIGTERM) 22:39:45.246256 --- ParallelTerminationStrategy: PID 22923 died... 22:39:45.265729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22923): Terminated: ok {rc=0} 22:39:45.311260 --- ParallelTerminationStrategy: PID 22926 died... 22:39:45.330484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22926): Terminated: ok {rc=0} 22:39:45.375839 --- ParallelTerminationStrategy: PID 22929 died... 22:39:45.394850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22929): Terminated: ok {rc=0} 22:39:45.482726 bus /sierra_3: Setting Powered False 22:39:46.581172 bus /sierra_3: Setting Powered False 22:39:47.696545 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:39:48.954343 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:39:48.960804 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:39:48.990341 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 22:39:49.017514 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 22:39:49.070829 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:39:49.100528 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 22:39:49.127580 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 22:39:49.678948 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 22:39:49.731012 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:39:49.742494 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:39:49.809201 tst mo_mt_call.py: using LAC 17238 22:39:49.936447 tst mo_mt_call.py: using RAC 153 22:39:50.063727 tst mo_mt_call.py: using CellId 17238 22:39:50.186345 tst mo_mt_call.py: using BVCI 17239 22:39:50.300360 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:39:50.311589 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:39:50.322594 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:39:50.333584 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:39:50.344814 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:39:50.356038 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:39:50.473909 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:39:50.590962 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:39:51.066936 run create_hlr_db(pid=22936): Launched 22:39:51.183521 bus /sierra_2: Setting Powered False 22:39:52.244834 run create_hlr_db(pid=22936): Terminated: ok {rc=0} 22:39:52.671673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22938): Launched 22:39:52.978383 run osmo-hlr_10.42.42.2(pid=22939): Launched 22:39:53.095281 run osmo-stp_10.42.42.5: Starting osmo-stp 22:39:53.620280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22941): Launched 22:39:53.926104 run osmo-stp_10.42.42.5(pid=22942): Launched 22:39:54.042940 run osmo-msc_10.42.42.6: Starting osmo-msc 22:39:54.596004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22944): Launched 22:39:54.902269 run osmo-msc_10.42.42.6(pid=22945): Launched 22:39:55.073582 run osmo-stp_10.42.42.5(pid=22942): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22942)] 22:39:55.203674 run osmo-stp_10.42.42.5(pid=22942): stdout: | (launched: 2022-12-08_22:39:53.869597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:55.333815 run osmo-stp_10.42.42.5(pid=22942): stderr: | 20221208223954039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223954039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223954039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223954040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223954040 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223954040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223954040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:55.461790 run osmo-stp_10.42.42.5(pid=22942): stdout: | (launched: 2022-12-08_22:39:53.869597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:55.584137 run osmo-stp_10.42.42.5(pid=22942): stderr: | 20221208223954039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208223954039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208223954039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208223954040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208223954040 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208223954040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208223954040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:55.730278 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22942): Process ended prematurely: osmo-stp_10.42.42.5(pid=22942) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22942)] [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 22:39:55.739019 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:39:55.766486 run osmo-hlr_10.42.42.2(pid=22939): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22939)] 22:39:55.815606 run osmo-hlr_10.42.42.2(pid=22939): stdout: | (launched: 2022-12-08_22:39:52.922459) 22:39:55.866501 run osmo-hlr_10.42.42.2(pid=22939): stderr: | 20221208223953096 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208223953096 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208223953096 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208223953096 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208223953096 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208223953096 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208223953108 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208223953116 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208223953116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208223953116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:39:55.937347 run osmo-msc_10.42.42.6(pid=22945): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22945)] 22:39:55.986315 run osmo-msc_10.42.42.6(pid=22945): stdout: | (launched: 2022-12-08_22:39:54.846471) 22:39:56.037214 run osmo-msc_10.42.42.6(pid=22945): stderr: | 20221208223955116 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208223955116 DLGLOBAL DEBUG validating counter group 0x7ff4f60e3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208223955116 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208223955116 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208223955116 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208223955117 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208223955118 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208223955119 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208223955120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208223955120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:39:56.088136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22938): Terminating (SIGTERM) 22:39:56.128736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22941): Terminating (SIGTERM) 22:39:56.169318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22944): Terminating (SIGTERM) 22:39:56.210354 --- ParallelTerminationStrategy: PID 22938 died... 22:39:56.229817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22938): Terminated: ok {rc=0} 22:39:56.275303 --- ParallelTerminationStrategy: PID 22941 died... 22:39:56.294411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22941): Terminated: ok {rc=0} 22:39:56.340068 --- ParallelTerminationStrategy: PID 22944 died... 22:39:56.358927 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22944): Terminated: ok {rc=0} 22:39:56.444633 bus /sierra_3: Setting Powered False 22:39:57.541485 bus /sierra_3: Setting Powered False 22:39:58.657279 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 22:39:59.804556 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:39:59.816425 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:39:59.882737 tst mo_mt_call_osmux.py: using LAC 17239 22:40:00.003926 tst mo_mt_call_osmux.py: using RAC 154 22:40:00.126374 tst mo_mt_call_osmux.py: using CellId 17239 22:40:00.249221 tst mo_mt_call_osmux.py: using BVCI 17240 22:40:00.360045 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:40:00.371265 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:40:00.382200 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:40:00.393494 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:40:00.404645 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:40:00.415789 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:40:00.533969 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:40:00.652771 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:40:01.173944 run create_hlr_db(pid=22947): Launched 22:40:01.352295 bus /sierra_2: Setting Powered False 22:40:02.422097 run create_hlr_db(pid=22947): Terminated: ok {rc=0} 22:40:02.877874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22959): Launched 22:40:03.204609 run osmo-hlr_10.42.42.2(pid=22960): Launched 22:40:03.328118 run osmo-stp_10.42.42.5: Starting osmo-stp 22:40:03.890230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22962): Launched 22:40:04.216212 run osmo-stp_10.42.42.5(pid=22963): Launched 22:40:04.339656 run osmo-msc_10.42.42.6: Starting osmo-msc 22:40:04.929288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22965): Launched 22:40:05.256176 run osmo-msc_10.42.42.6(pid=22966): Launched 22:40:05.438451 run osmo-stp_10.42.42.5(pid=22963): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22963)] 22:40:05.575846 run osmo-stp_10.42.42.5(pid=22963): stdout: | (launched: 2022-12-08_22:40:04.156837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:05.714320 run osmo-stp_10.42.42.5(pid=22963): stderr: | 20221208224004350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224004350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224004351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224004351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224004351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224004351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224004351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:05.851476 run osmo-stp_10.42.42.5(pid=22963): stdout: | (launched: 2022-12-08_22:40:04.156837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:05.981461 run osmo-stp_10.42.42.5(pid=22963): stderr: | 20221208224004350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224004350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224004351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224004351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224004351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224004351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224004351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:06.136789 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22963): Process ended prematurely: osmo-stp_10.42.42.5(pid=22963) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22963)] [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 22:40:06.146381 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 22:40:06.174665 run osmo-hlr_10.42.42.2(pid=22960): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22960)] 22:40:06.225692 run osmo-hlr_10.42.42.2(pid=22960): stdout: | (launched: 2022-12-08_22:40:03.145454) 22:40:06.278360 run osmo-hlr_10.42.42.2(pid=22960): stderr: | 20221208224003346 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224003346 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224003346 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224003346 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224003346 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224003346 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224003359 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224003367 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224003367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224003367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:40:06.352247 run osmo-msc_10.42.42.6(pid=22966): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22966)] 22:40:06.403091 run osmo-msc_10.42.42.6(pid=22966): stdout: | (launched: 2022-12-08_22:40:05.196936) 22:40:06.455552 run osmo-msc_10.42.42.6(pid=22966): stderr: | 20221208224005518 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208224005518 DLGLOBAL DEBUG validating counter group 0x7f8ac5a55c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208224005518 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208224005518 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208224005518 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208224005518 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208224005521 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208224005522 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208224005522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208224005522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:40:06.508494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22959): Terminating (SIGTERM) 22:40:06.550941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22962): Terminating (SIGTERM) 22:40:06.593831 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22965): Terminating (SIGTERM) 22:40:06.636884 --- ParallelTerminationStrategy: PID 22959 died... 22:40:06.657487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22959): Terminated: ok {rc=0} 22:40:06.704755 --- ParallelTerminationStrategy: PID 22962 died... 22:40:06.724886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22962): Terminated: ok {rc=0} 22:40:06.772095 --- ParallelTerminationStrategy: PID 22965 died... 22:40:06.792211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22965): Terminated: ok {rc=0} 22:40:06.881044 bus /sierra_3: Setting Powered False 22:40:07.980764 bus /sierra_3: Setting Powered False 22:40:09.099429 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 22:40:10.345018 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:40:10.349299 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 22:40:10.379070 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 22:40:10.405826 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 22:40:10.491402 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 22:40:10.521720 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 22:40:10.549542 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 22:40:11.128851 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2350 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 22:40:11.133836 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:11.144414 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:40:11.189054 tst emergency_mo_mt_call.py: using LAC 17240 22:40:11.307147 tst emergency_mo_mt_call.py: using RAC 155 22:40:11.426330 tst emergency_mo_mt_call.py: using CellId 17240 22:40:11.550256 tst emergency_mo_mt_call.py: using BVCI 17241 22:40:11.661749 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:11.673110 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:11.683640 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:11.694616 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:11.705451 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:11.716216 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:11.834391 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:11.952417 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:40:12.461232 run create_hlr_db(pid=22983): Launched 22:40:12.595592 bus /sierra_2: Setting Powered False 22:40:13.656583 run create_hlr_db(pid=22983): Terminated: ok {rc=0} 22:40:14.093563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23252): Launched 22:40:14.422616 run osmo-hlr_10.42.42.2(pid=23325): Launched 22:40:14.545053 run osmo-stp_10.42.42.5: Starting osmo-stp 22:40:15.098184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23327): Launched 22:40:15.418021 run osmo-stp_10.42.42.5(pid=23328): Launched 22:40:15.549060 tst emergency_mo_mt_call.py: using MSISDN 6884 22:40:15.711969 run osmo-msc_10.42.42.6: Starting osmo-msc 22:40:16.413635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23330): Launched 22:40:16.773105 run osmo-msc_10.42.42.6(pid=23331): Launched 22:40:16.958652 run osmo-stp_10.42.42.5(pid=23328): ERR: Terminated: ERROR {rc=1} [trial-2350↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23328)] 22:40:17.245465 run osmo-stp_10.42.42.5(pid=23328): stdout: | (launched: 2022-12-08_22:40:15.359863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:17.477634 run osmo-stp_10.42.42.5(pid=23328): stderr: | 20221208224015552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224015552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224015553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224015553 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224015554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224015554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224015554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:17.615275 run osmo-stp_10.42.42.5(pid=23328): stdout: | (launched: 2022-12-08_22:40:15.359863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:17.743664 run osmo-stp_10.42.42.5(pid=23328): stderr: | 20221208224015552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224015552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224015553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224015553 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224015554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224015554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224015554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:17.896606 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=23328): Process ended prematurely: osmo-stp_10.42.42.5(pid=23328) [trial-2350↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23328)] [trial-2350↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 22:40:17.905737 tst emergency_mo_mt_call.py:19: Test FAILED (6.8 sec) 22:40:17.933517 run osmo-hlr_10.42.42.2(pid=23325): ERR: Terminated: ERROR {rc=237} [trial-2350↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23325)] 22:40:17.984870 run osmo-hlr_10.42.42.2(pid=23325): stdout: | (launched: 2022-12-08_22:40:14.363554) 22:40:18.037866 run osmo-hlr_10.42.42.2(pid=23325): stderr: | 20221208224014560 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224014560 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224014560 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224014560 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224014560 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224014560 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224014574 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224014583 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224014583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224014583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:40:18.111309 run osmo-msc_10.42.42.6(pid=23331): ERR: Terminated: ERROR {rc=2} [trial-2350↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23331)] 22:40:18.162044 run osmo-msc_10.42.42.6(pid=23331): stdout: | (launched: 2022-12-08_22:40:16.712200) 22:40:18.214379 run osmo-msc_10.42.42.6(pid=23331): stderr: | 20221208224017341 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208224017341 DLGLOBAL DEBUG validating counter group 0x7f14eb6f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208224017341 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208224017341 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208224017342 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208224017342 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208224017344 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208224017344 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208224017344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208224017344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:40:18.267108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23252): Terminating (SIGTERM) 22:40:18.309211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23327): Terminating (SIGTERM) 22:40:18.351498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23330): Terminating (SIGTERM) 22:40:18.394121 --- ParallelTerminationStrategy: PID 23252 died... 22:40:18.414522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23252): Terminated: ok {rc=0} 22:40:18.461646 --- ParallelTerminationStrategy: PID 23327 died... 22:40:18.481652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23327): Terminated: ok {rc=0} 22:40:18.528781 --- ParallelTerminationStrategy: PID 23330 died... 22:40:18.549150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23330): Terminated: ok {rc=0} 22:40:18.638750 bus /sierra_3: Setting Powered False 22:40:19.740709 bus /sierra_3: Setting Powered False 22:40:20.857163 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 22:40:21.945493 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:21.957598 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:40:22.005528 tst emergency_preemptive_call.py: using LAC 17241 22:40:22.133131 tst emergency_preemptive_call.py: using RAC 156 22:40:22.258255 tst emergency_preemptive_call.py: using CellId 17241 22:40:22.385280 tst emergency_preemptive_call.py: using BVCI 17242 22:40:22.502038 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:22.514001 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:22.525378 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:22.536729 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:22.548646 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:22.560251 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:22.677214 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:22.811694 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:22.934784 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:23.057085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:40:23.573658 run create_hlr_db(pid=23501): Launched 22:40:23.727131 bus /sierra_2: Setting Powered False 22:40:24.791805 run create_hlr_db(pid=23501): Terminated: ok {rc=0} 22:40:25.252344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23510): Launched 22:40:25.596033 run osmo-hlr_10.42.42.2(pid=23511): Launched 22:40:25.842927 run osmo-stp_10.42.42.5: Starting osmo-stp 22:40:26.505907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23513): Launched 22:40:26.847346 run osmo-stp_10.42.42.5(pid=23514): Launched 22:40:27.104734 tst emergency_preemptive_call.py: using MSISDN 6885 22:40:27.343224 run osmo-msc_10.42.42.6: Starting osmo-msc 22:40:27.939685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23516): Launched 22:40:28.279994 run osmo-msc_10.42.42.6(pid=23517): Launched 22:40:28.648849 run osmo-stp_10.42.42.5(pid=23514): ERR: Terminated: ERROR {rc=1} [trial-2350↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23514)] 22:40:28.820335 run osmo-stp_10.42.42.5(pid=23514): stdout: | (launched: 2022-12-08_22:40:26.786079) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:28.959658 run osmo-stp_10.42.42.5(pid=23514): stderr: | 20221208224027083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224027083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224027083 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224027084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224027084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224027084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224027084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:29.094688 run osmo-stp_10.42.42.5(pid=23514): stdout: | (launched: 2022-12-08_22:40:26.786079) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:29.223707 run osmo-stp_10.42.42.5(pid=23514): stderr: | 20221208224027083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224027083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224027083 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224027084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224027084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224027084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224027084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:29.377156 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=23514): Process ended prematurely: osmo-stp_10.42.42.5(pid=23514) [trial-2350↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23514)] [trial-2350↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 22:40:29.386447 tst emergency_preemptive_call.py:32: Test FAILED (7.4 sec) 22:40:29.414757 run osmo-hlr_10.42.42.2(pid=23511): ERR: Terminated: ERROR {rc=237} [trial-2350↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23511)] 22:40:29.466742 run osmo-hlr_10.42.42.2(pid=23511): stdout: | (launched: 2022-12-08_22:40:25.532193) 22:40:29.520228 run osmo-hlr_10.42.42.2(pid=23511): stderr: | 20221208224025845 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224025845 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224025845 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224025845 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224025845 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224025846 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224025859 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224025870 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224025871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224025871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:40:29.594909 run osmo-msc_10.42.42.6(pid=23517): ERR: Terminated: ERROR {rc=2} [trial-2350↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23517)] 22:40:29.646575 run osmo-msc_10.42.42.6(pid=23517): stdout: | (launched: 2022-12-08_22:40:28.219529) 22:40:29.699910 run osmo-msc_10.42.42.6(pid=23517): stderr: | 20221208224028715 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208224028715 DLGLOBAL DEBUG validating counter group 0x7f2029d3dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208224028715 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208224028715 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208224028715 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208224028716 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208224028718 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208224028718 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208224028718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208224028718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:40:29.753332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23510): Terminating (SIGTERM) 22:40:29.796277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23513): Terminating (SIGTERM) 22:40:29.839344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23516): Terminating (SIGTERM) 22:40:29.883229 --- ParallelTerminationStrategy: PID 23510 died... 22:40:29.903587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23510): Terminated: ok {rc=0} 22:40:29.951045 --- ParallelTerminationStrategy: PID 23513 died... 22:40:29.971146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23513): Terminated: ok {rc=0} 22:40:30.018557 --- ParallelTerminationStrategy: PID 23516 died... 22:40:30.038780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23516): Terminated: ok {rc=0} 22:40:30.127554 bus /sierra_9: Setting Powered False 22:40:31.247606 bus /sierra_9: Setting Powered False 22:40:32.366824 bus /sierra_8: Setting Powered False 22:40:33.467253 bus /sierra_8: Setting Powered False 22:40:34.584548 bus /sierra_3: Setting Powered False 22:40:35.685117 bus /sierra_3: Setting Powered False 22:40:36.801040 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 22:40:38.074078 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:40:38.079008 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 22:40:38.108908 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 22:40:38.148098 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 22:40:38.236271 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 22:40:38.266236 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 22:40:38.305523 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 22:40:38.899347 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 22:40:38.952314 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:38.963499 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:40:39.013920 tst cs_paging_gprs_active.py: using LAC 17242 22:40:39.141393 tst cs_paging_gprs_active.py: using RAC 157 22:40:39.267674 tst cs_paging_gprs_active.py: using CellId 17242 22:40:39.400619 tst cs_paging_gprs_active.py: using BVCI 17243 22:40:39.519431 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:39.530647 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:39.541738 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:39.552646 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:39.563584 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:39.574577 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:39.585706 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:39.596584 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:39.608070 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:39.724896 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:39.843750 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:40:40.050763 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:40:40.359888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23523): Launched 22:40:40.628373 run iperf3-srv_10.42.42.10(pid=23524): Launched 22:40:40.743901 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:40:40.950241 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:40:41.258425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23525): Launched 22:40:41.527226 run iperf3-srv_10.42.42.10(pid=23526): Launched 22:40:41.643240 tst cs_paging_gprs_active.py:38: start network... 22:40:41.848873 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:40:42.347938 run create_hlr_db(pid=23527): Launched 22:40:42.466112 bus /sierra_2: Setting Powered False 22:40:43.530374 run create_hlr_db(pid=23527): Terminated: ok {rc=0} 22:40:43.987399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23529): Launched 22:40:44.313687 run osmo-hlr_10.42.42.2(pid=23530): Launched 22:40:44.438175 run osmo-stp_10.42.42.5: Starting osmo-stp 22:40:44.999619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23532): Launched 22:40:45.328036 run osmo-stp_10.42.42.5(pid=23533): Launched 22:40:45.453848 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:40:46.031037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23535): Launched 22:40:46.165075 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:40:46.438537 run patchelf(pid=23536): Launched 22:40:46.632099 run osmo-stp_10.42.42.5(pid=23533): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23533)] 22:40:46.769768 run osmo-stp_10.42.42.5(pid=23533): stdout: | (launched: 2022-12-08_22:40:45.267647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:46.909847 run osmo-stp_10.42.42.5(pid=23533): stderr: | 20221208224045461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224045461 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224045461 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224045462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224045462 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224045462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224045462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:47.049340 run osmo-stp_10.42.42.5(pid=23533): stdout: | (launched: 2022-12-08_22:40:45.267647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:47.182653 run osmo-stp_10.42.42.5(pid=23533): stderr: | 20221208224045461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224045461 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224045461 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224045462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224045462 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224045462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224045462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:47.333484 run patchelf(pid=23536): Terminating (SIGINT) 22:40:47.507459 run patchelf(pid=23536): Terminated: ok {rc=0} 22:40:47.633277 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23533): Process ended prematurely: osmo-stp_10.42.42.5(pid=23533) [trial-2350↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23533)] [trial-2350↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 22:40:47.643154 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:40:47.672207 run osmo-hlr_10.42.42.2(pid=23530): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23530)] 22:40:47.721901 run osmo-hlr_10.42.42.2(pid=23530): stdout: | (launched: 2022-12-08_22:40:44.254558) 22:40:47.773133 run osmo-hlr_10.42.42.2(pid=23530): stderr: | 20221208224044454 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224044454 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224044454 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224044454 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224044454 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224044454 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224044467 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224044477 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224044477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224044477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:40:47.824831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23523): Terminating (SIGTERM) 22:40:47.866377 run iperf3-srv_10.42.42.10(pid=23524): Terminating (SIGTERM) 22:40:47.907869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23525): Terminating (SIGTERM) 22:40:47.949671 run iperf3-srv_10.42.42.10(pid=23526): Terminating (SIGTERM) 22:40:47.991096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23529): Terminating (SIGTERM) 22:40:48.032680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23532): Terminating (SIGTERM) 22:40:48.074197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23535): Terminating (SIGTERM) 22:40:48.116116 --- ParallelTerminationStrategy: PID 23523 died... 22:40:48.135647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23523): Terminated: ok {rc=0} 22:40:48.182176 --- ParallelTerminationStrategy: PID 23524 died... 22:40:48.201556 run iperf3-srv_10.42.42.10(pid=23524): Terminated {rc=256} 22:40:48.247893 --- ParallelTerminationStrategy: PID 23525 died... 22:40:48.267225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23525): Terminated: ok {rc=0} 22:40:48.313460 --- ParallelTerminationStrategy: PID 23526 died... 22:40:48.332683 run iperf3-srv_10.42.42.10(pid=23526): Terminated {rc=256} 22:40:48.378753 --- ParallelTerminationStrategy: PID 23529 died... 22:40:48.398043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23529): Terminated: ok {rc=0} 22:40:48.444212 --- ParallelTerminationStrategy: PID 23532 died... 22:40:48.463662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23532): Terminated: ok {rc=0} 22:40:48.509934 --- ParallelTerminationStrategy: PID 23535 died... 22:40:48.529485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23535): Terminated: ok {rc=0} 22:40:48.617916 bus /gobi_0: Setting Powered False 22:40:49.718926 bus /gobi_0: Setting Powered False 22:40:50.833395 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 22:40:51.984325 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:51.996159 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:40:52.044598 tst iperf3.py: using LAC 17243 22:40:52.173063 tst iperf3.py: using RAC 158 22:40:52.303457 tst iperf3.py: using CellId 17243 22:40:52.433015 tst iperf3.py: using BVCI 17244 22:40:52.552861 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:52.564186 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:52.575235 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:52.586333 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:52.597292 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:52.608139 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:52.619619 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:52.630660 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:52.641784 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:52.760262 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:40:52.980716 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:40:53.309776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23537): Launched 22:40:53.595606 run iperf3-srv_10.42.42.10(pid=23538): Launched 22:40:53.718532 tst iperf3.py:8: start network... 22:40:53.939297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:40:54.446168 run create_hlr_db(pid=23539): Launched 22:40:54.578728 bus /gobi_6: Setting Powered False 22:40:55.643267 run create_hlr_db(pid=23539): Terminated: ok {rc=0} 22:40:56.078734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23541): Launched 22:40:56.384809 run osmo-hlr_10.42.42.2(pid=23542): Launched 22:40:56.502509 run osmo-stp_10.42.42.5: Starting osmo-stp 22:40:57.033642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23544): Launched 22:40:57.340727 run osmo-stp_10.42.42.5(pid=23545): Launched 22:40:57.457846 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:40:57.984138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23547): Launched 22:40:58.101403 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:40:58.360238 run patchelf(pid=23548): Launched 22:40:58.530937 run osmo-stp_10.42.42.5(pid=23545): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23545)] 22:40:58.661285 run osmo-stp_10.42.42.5(pid=23545): stdout: | (launched: 2022-12-08_22:40:57.284743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:58.792851 run osmo-stp_10.42.42.5(pid=23545): stderr: | 20221208224057454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224057454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224057455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224057455 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224057455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224057456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224057456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:58.925235 run osmo-stp_10.42.42.5(pid=23545): stdout: | (launched: 2022-12-08_22:40:57.284743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:59.053961 run osmo-stp_10.42.42.5(pid=23545): stderr: | 20221208224057454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224057454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224057455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224057455 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224057455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224057456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224057456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:59.204024 run patchelf(pid=23548): Terminating (SIGINT) 22:40:59.377399 run patchelf(pid=23548): Terminated: ok {rc=0} 22:40:59.502419 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23545): Process ended prematurely: osmo-stp_10.42.42.5(pid=23545) [trial-2350↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23545)] [trial-2350↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 22:40:59.511845 tst iperf3.py:8: Test FAILED (7.6 sec) 22:40:59.540025 run osmo-hlr_10.42.42.2(pid=23542): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23542)] 22:40:59.589354 run osmo-hlr_10.42.42.2(pid=23542): stdout: | (launched: 2022-12-08_22:40:56.328789) 22:40:59.640284 run osmo-hlr_10.42.42.2(pid=23542): stderr: | 20221208224056504 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224056504 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224056504 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224056504 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224056504 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224056504 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224056517 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224056527 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224056527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224056527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:40:59.691408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23537): Terminating (SIGTERM) 22:40:59.732270 run iperf3-srv_10.42.42.10(pid=23538): Terminating (SIGTERM) 22:40:59.773062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23541): Terminating (SIGTERM) 22:40:59.814524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23544): Terminating (SIGTERM) 22:40:59.855664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23547): Terminating (SIGTERM) 22:40:59.896922 --- ParallelTerminationStrategy: PID 23537 died... 22:40:59.916488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23537): Terminated: ok {rc=0} 22:40:59.962588 --- ParallelTerminationStrategy: PID 23538 died... 22:40:59.981744 run iperf3-srv_10.42.42.10(pid=23538): Terminated {rc=256} 22:41:00.027526 --- ParallelTerminationStrategy: PID 23541 died... 22:41:00.046682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23541): Terminated: ok {rc=0} 22:41:00.092531 --- ParallelTerminationStrategy: PID 23544 died... 22:41:00.111725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23544): Terminated: ok {rc=0} 22:41:00.157593 --- ParallelTerminationStrategy: PID 23547 died... 22:41:00.176701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23547): Terminated: ok {rc=0} 22:41:00.264180 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 22:41:01.422004 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:01.434219 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:41:01.481977 tst iperf3m4.py: using LAC 17244 22:41:01.640204 tst iperf3m4.py: using RAC 159 22:41:01.800765 tst iperf3m4.py: using CellId 17244 22:41:01.960266 tst iperf3m4.py: using BVCI 17245 22:41:02.097149 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:02.109265 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:02.121067 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:02.133824 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:02.147293 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:02.159003 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:02.171630 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:02.185180 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:02.196859 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:41:02.315265 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:41:02.434170 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:41:02.549724 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:41:02.669457 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:41:02.875319 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:41:03.183312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23549): Launched 22:41:03.450148 run iperf3-srv_10.42.42.10(pid=23550): Launched 22:41:03.565302 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:41:03.770397 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:41:04.077183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23551): Launched 22:41:04.342600 run iperf3-srv_10.42.42.10(pid=23552): Launched 22:41:04.457551 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:41:04.662812 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:41:04.969475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23553): Launched 22:41:05.235868 run iperf3-srv_10.42.42.10(pid=23554): Launched 22:41:05.350630 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:41:05.555557 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:41:05.862552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23555): Launched 22:41:06.129206 run iperf3-srv_10.42.42.10(pid=23556): Launched 22:41:06.244007 tst iperf3m4.py:8: start network... 22:41:06.448428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:41:06.922416 run create_hlr_db(pid=23557): Launched 22:41:07.039636 bus /gobi_6: Setting Powered False 22:41:08.101362 run create_hlr_db(pid=23557): Terminated: ok {rc=0} 22:41:08.527438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23560): Launched 22:41:08.833373 run osmo-hlr_10.42.42.2(pid=23561): Launched 22:41:08.951080 run osmo-stp_10.42.42.5: Starting osmo-stp 22:41:09.599058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23563): Launched 22:41:09.897703 run osmo-stp_10.42.42.5(pid=23564): Launched 22:41:10.012127 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:41:10.531225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23566): Launched 22:41:10.646199 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:41:10.899196 run patchelf(pid=23567): Launched 22:41:11.066454 run osmo-stp_10.42.42.5(pid=23564): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23564)] 22:41:11.193852 run osmo-stp_10.42.42.5(pid=23564): stdout: | (launched: 2022-12-08_22:41:09.843244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:11.322511 run osmo-stp_10.42.42.5(pid=23564): stderr: | 20221208224110014 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224110014 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224110014 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224110015 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224110015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224110015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224110015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:11.450909 run osmo-stp_10.42.42.5(pid=23564): stdout: | (launched: 2022-12-08_22:41:09.843244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:11.575288 run osmo-stp_10.42.42.5(pid=23564): stderr: | 20221208224110014 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224110014 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224110014 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224110015 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224110015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224110015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224110015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:11.721811 run patchelf(pid=23567): Terminating (SIGINT) 22:41:11.890617 run patchelf(pid=23567): Terminated: ok {rc=0} 22:41:12.012411 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23564): Process ended prematurely: osmo-stp_10.42.42.5(pid=23564) [trial-2350↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23564)] [trial-2350↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 22:41:12.022069 tst iperf3m4.py:8: Test FAILED (10.6 sec) 22:41:12.050116 run osmo-hlr_10.42.42.2(pid=23561): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23561)] 22:41:12.098974 run osmo-hlr_10.42.42.2(pid=23561): stdout: | (launched: 2022-12-08_22:41:08.777241) 22:41:12.149295 run osmo-hlr_10.42.42.2(pid=23561): stderr: | 20221208224108953 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224108953 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224108953 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224108953 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224108953 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224108953 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224108965 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224108973 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224108973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224108973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:41:12.199567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23549): Terminating (SIGTERM) 22:41:12.239992 run iperf3-srv_10.42.42.10(pid=23550): Terminating (SIGTERM) 22:41:12.280289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23551): Terminating (SIGTERM) 22:41:12.320636 run iperf3-srv_10.42.42.10(pid=23552): Terminating (SIGTERM) 22:41:12.361002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23553): Terminating (SIGTERM) 22:41:12.401317 run iperf3-srv_10.42.42.10(pid=23554): Terminating (SIGTERM) 22:41:12.441456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23555): Terminating (SIGTERM) 22:41:12.481879 run iperf3-srv_10.42.42.10(pid=23556): Terminating (SIGTERM) 22:41:12.522006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23560): Terminating (SIGTERM) 22:41:12.562354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23563): Terminating (SIGTERM) 22:41:12.602678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23566): Terminating (SIGTERM) 22:41:12.643210 --- ParallelTerminationStrategy: PID 23549 died... 22:41:12.662596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23549): Terminated: ok {rc=0} 22:41:12.707695 --- ParallelTerminationStrategy: PID 23550 died... 22:41:12.726634 run iperf3-srv_10.42.42.10(pid=23550): Terminated {rc=256} 22:41:12.771625 --- ParallelTerminationStrategy: PID 23551 died... 22:41:12.790578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23551): Terminated: ok {rc=0} 22:41:12.835550 --- ParallelTerminationStrategy: PID 23552 died... 22:41:12.854381 run iperf3-srv_10.42.42.10(pid=23552): Terminated {rc=256} 22:41:12.899781 --- ParallelTerminationStrategy: PID 23553 died... 22:41:12.918793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23553): Terminated: ok {rc=0} 22:41:12.963636 --- ParallelTerminationStrategy: PID 23554 died... 22:41:12.982353 run iperf3-srv_10.42.42.10(pid=23554): Terminated {rc=256} 22:41:13.027097 --- ParallelTerminationStrategy: PID 23555 died... 22:41:13.045947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23555): Terminated: ok {rc=0} 22:41:13.090772 --- ParallelTerminationStrategy: PID 23556 died... 22:41:13.109784 run iperf3-srv_10.42.42.10(pid=23556): Terminated {rc=256} 22:41:13.155094 --- ParallelTerminationStrategy: PID 23560 died... 22:41:13.173908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23560): Terminated: ok {rc=0} 22:41:13.218964 --- ParallelTerminationStrategy: PID 23563 died... 22:41:13.237643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23563): Terminated: ok {rc=0} 22:41:13.282353 --- ParallelTerminationStrategy: PID 23566 died... 22:41:13.301114 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23566): Terminated: ok {rc=0} 22:41:13.387509 bus /gobi_4: Setting Powered False 22:41:14.485978 bus /gobi_4: Setting Powered False 22:41:15.600726 bus /gobi_1: Setting Powered False 22:41:16.696784 bus /gobi_1: Setting Powered False 22:41:17.812772 bus /gobi_0: Setting Powered False 22:41:18.911281 bus /gobi_0: Setting Powered False 22:41:20.029078 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 22:41:21.133015 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:21.144887 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:41:21.191213 tst ping.py: using LAC 17245 22:41:21.314309 tst ping.py: using RAC 160 22:41:21.439876 tst ping.py: using CellId 17245 22:41:21.562237 tst ping.py: using BVCI 17246 22:41:21.680530 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:21.691697 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:21.702765 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:21.714019 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:21.725110 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:21.736216 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:21.747344 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:21.758315 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:41:21.872493 tst ping.py:19: start network... 22:41:22.082209 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:41:22.566016 run create_hlr_db(pid=23569): Launched 22:41:22.694481 bus /gobi_6: Setting Powered False 22:41:23.756895 run create_hlr_db(pid=23569): Terminated: ok {rc=0} 22:41:24.196045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23571): Launched 22:41:24.510161 run osmo-hlr_10.42.42.2(pid=23572): Launched 22:41:24.630052 run osmo-stp_10.42.42.5: Starting osmo-stp 22:41:25.173336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23574): Launched 22:41:25.486728 run osmo-stp_10.42.42.5(pid=23575): Launched 22:41:25.605776 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:41:26.148102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23577): Launched 22:41:26.268484 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:41:26.533684 run patchelf(pid=23578): Launched 22:41:26.710022 run osmo-stp_10.42.42.5(pid=23575): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23575)] 22:41:26.844717 run osmo-stp_10.42.42.5(pid=23575): stdout: | (launched: 2022-12-08_22:41:25.430079) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:26.981078 run osmo-stp_10.42.42.5(pid=23575): stderr: | 20221208224125620 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224125620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224125620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224125620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224125621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224125621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224125621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:27.116782 run osmo-stp_10.42.42.5(pid=23575): stdout: | (launched: 2022-12-08_22:41:25.430079) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:27.247017 run osmo-stp_10.42.42.5(pid=23575): stderr: | 20221208224125620 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224125620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224125620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224125620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224125621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224125621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224125621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:27.400898 run patchelf(pid=23578): Terminating (SIGINT) 22:41:27.579191 run patchelf(pid=23578): Terminated: ok {rc=0} 22:41:27.708217 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23575): Process ended prematurely: osmo-stp_10.42.42.5(pid=23575) [trial-2350↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23575)] [trial-2350↪gprs:trx-lms-limenet-micro↪ping.py:22] 22:41:27.717807 tst ping.py:22: Test FAILED (6.6 sec) 22:41:27.746150 run osmo-hlr_10.42.42.2(pid=23572): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23572)] 22:41:27.797124 run osmo-hlr_10.42.42.2(pid=23572): stdout: | (launched: 2022-12-08_22:41:24.453449) 22:41:27.849613 run osmo-hlr_10.42.42.2(pid=23572): stderr: | 20221208224124651 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224124651 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224124651 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224124651 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224124652 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224124652 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224124665 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224124673 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224124673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224124673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:41:27.902503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23571): Terminating (SIGTERM) 22:41:27.945445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23574): Terminating (SIGTERM) 22:41:27.988083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23577): Terminating (SIGTERM) 22:41:28.030950 --- ParallelTerminationStrategy: PID 23571 died... 22:41:28.051224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23571): Terminated: ok {rc=0} 22:41:28.098532 --- ParallelTerminationStrategy: PID 23574 died... 22:41:28.118374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23574): Terminated: ok {rc=0} 22:41:28.165659 --- ParallelTerminationStrategy: PID 23577 died... 22:41:28.185484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23577): Terminated: ok {rc=0} 22:41:28.274532 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 22:41:29.362098 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:29.374330 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:41:29.421465 tst ping_idle_ping.py: using LAC 17246 22:41:29.547931 tst ping_idle_ping.py: using RAC 161 22:41:29.672306 tst ping_idle_ping.py: using CellId 17246 22:41:29.798779 tst ping_idle_ping.py: using BVCI 17247 22:41:29.913650 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:29.924909 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:29.936213 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:29.947366 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:29.958465 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:29.969603 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:29.980853 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:29.991903 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:41:30.109363 tst ping_idle_ping.py:24: start network... 22:41:30.321930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:41:30.812650 run create_hlr_db(pid=23579): Launched 22:41:30.972856 bus /gobi_6: Setting Powered False 22:41:32.032151 run create_hlr_db(pid=23579): Terminated: ok {rc=0} 22:41:32.454837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23581): Launched 22:41:32.751485 run osmo-hlr_10.42.42.2(pid=23582): Launched 22:41:32.864087 run osmo-stp_10.42.42.5: Starting osmo-stp 22:41:33.373749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23584): Launched 22:41:33.670572 run osmo-stp_10.42.42.5(pid=23585): Launched 22:41:33.783846 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:41:34.295541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23587): Launched 22:41:34.409059 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:41:34.659786 run patchelf(pid=23588): Launched 22:41:34.825238 run osmo-stp_10.42.42.5(pid=23585): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23585)] 22:41:34.951884 run osmo-stp_10.42.42.5(pid=23585): stdout: | (launched: 2022-12-08_22:41:33.616571) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:35.080002 run osmo-stp_10.42.42.5(pid=23585): stderr: | 20221208224133787 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224133787 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224133787 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224133788 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224133788 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224133788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224133788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:35.208304 run osmo-stp_10.42.42.5(pid=23585): stdout: | (launched: 2022-12-08_22:41:33.616571) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:35.330623 run osmo-stp_10.42.42.5(pid=23585): stderr: | 20221208224133787 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224133787 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224133787 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224133788 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224133788 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224133788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224133788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:35.475084 run patchelf(pid=23588): Terminating (SIGINT) 22:41:35.642904 run patchelf(pid=23588): Terminated: ok {rc=0} 22:41:35.764228 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23585): Process ended prematurely: osmo-stp_10.42.42.5(pid=23585) [trial-2350↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23585)] [trial-2350↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 22:41:35.773433 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:41:35.800830 run osmo-hlr_10.42.42.2(pid=23582): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23582)] 22:41:35.849488 run osmo-hlr_10.42.42.2(pid=23582): stdout: | (launched: 2022-12-08_22:41:32.697142) 22:41:35.899823 run osmo-hlr_10.42.42.2(pid=23582): stderr: | 20221208224132872 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224132873 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224132873 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224132873 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224132873 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224132873 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224132884 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224132894 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224132894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224132894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:41:35.950473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23581): Terminating (SIGTERM) 22:41:35.990860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23584): Terminating (SIGTERM) 22:41:36.031272 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23587): Terminating (SIGTERM) 22:41:36.071859 --- ParallelTerminationStrategy: PID 23581 died... 22:41:36.090692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23581): Terminated: ok {rc=0} 22:41:36.135560 --- ParallelTerminationStrategy: PID 23584 died... 22:41:36.154364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23584): Terminated: ok {rc=0} 22:41:36.199239 --- ParallelTerminationStrategy: PID 23587 died... 22:41:36.217902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23587): Terminated: ok {rc=0} 22:41:36.304452 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 22:41:37.607389 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:41:37.613253 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:41:37.643598 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:41:37.684179 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:41:37.773116 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:41:37.803145 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:41:37.842780 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:41:38.433439 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:41:38.483222 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:38.494335 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:41:38.540386 tst cs_paging_gprs_active.py: using LAC 17247 22:41:38.658999 tst cs_paging_gprs_active.py: using RAC 162 22:41:38.779061 tst cs_paging_gprs_active.py: using CellId 17247 22:41:38.898954 tst cs_paging_gprs_active.py: using BVCI 17248 22:41:39.011154 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:39.022263 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:39.032998 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:39.043937 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:39.055018 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:39.066095 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:39.077143 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:39.087922 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:39.099032 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:41:39.215996 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:41:39.330906 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:41:39.533423 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:41:39.837217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23592): Launched 22:41:40.101166 run iperf3-srv_10.42.42.10(pid=23593): Launched 22:41:40.215876 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:41:40.418391 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:41:40.722389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23594): Launched 22:41:40.985402 run iperf3-srv_10.42.42.10(pid=23595): Launched 22:41:41.099647 tst cs_paging_gprs_active.py:38: start network... 22:41:41.301972 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:41:41.772821 run create_hlr_db(pid=23596): Launched 22:41:41.888006 bus /gobi_6: Setting Powered False 22:41:42.947971 run create_hlr_db(pid=23596): Terminated: ok {rc=0} 22:41:43.368590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23598): Launched 22:41:43.671382 run osmo-hlr_10.42.42.2(pid=23599): Launched 22:41:43.786751 run osmo-stp_10.42.42.5: Starting osmo-stp 22:41:44.317157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23601): Launched 22:41:44.619171 run osmo-stp_10.42.42.5(pid=23602): Launched 22:41:44.734405 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:41:45.256341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23604): Launched 22:41:45.372672 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:41:45.628646 run patchelf(pid=23605): Launched 22:41:45.796676 run osmo-stp_10.42.42.5(pid=23602): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23602)] 22:41:45.930363 run osmo-stp_10.42.42.5(pid=23602): stdout: | (launched: 2022-12-08_22:41:44.563664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:46.062176 run osmo-stp_10.42.42.5(pid=23602): stderr: | 20221208224144733 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224144733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224144734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224144734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224144735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224144735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224144735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:46.193986 run osmo-stp_10.42.42.5(pid=23602): stdout: | (launched: 2022-12-08_22:41:44.563664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:46.321824 run osmo-stp_10.42.42.5(pid=23602): stderr: | 20221208224144733 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224144733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224144734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224144734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224144735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224144735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224144735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:46.472219 run patchelf(pid=23605): Terminating (SIGINT) 22:41:46.645368 run patchelf(pid=23605): Terminated: ok {rc=0} 22:41:46.770502 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23602): Process ended prematurely: osmo-stp_10.42.42.5(pid=23602) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23602)] [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:41:46.780575 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 22:41:46.809800 run osmo-hlr_10.42.42.2(pid=23599): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23599)] 22:41:46.860153 run osmo-hlr_10.42.42.2(pid=23599): stdout: | (launched: 2022-12-08_22:41:43.616242) 22:41:46.912227 run osmo-hlr_10.42.42.2(pid=23599): stderr: | 20221208224143790 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224143790 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224143790 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224143790 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224143790 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224143790 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224143802 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224143814 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224143814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224143814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:41:46.965325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23592): Terminating (SIGTERM) 22:41:47.007684 run iperf3-srv_10.42.42.10(pid=23593): Terminating (SIGTERM) 22:41:47.051402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23594): Terminating (SIGTERM) 22:41:47.094162 run iperf3-srv_10.42.42.10(pid=23595): Terminating (SIGTERM) 22:41:47.136218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23598): Terminating (SIGTERM) 22:41:47.178308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23601): Terminating (SIGTERM) 22:41:47.220584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23604): Terminating (SIGTERM) 22:41:47.262622 --- ParallelTerminationStrategy: PID 23592 died... 22:41:47.281997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23592): Terminated: ok {rc=0} 22:41:47.327575 --- ParallelTerminationStrategy: PID 23593 died... 22:41:47.346507 run iperf3-srv_10.42.42.10(pid=23593): Terminated {rc=256} 22:41:47.391610 --- ParallelTerminationStrategy: PID 23594 died... 22:41:47.410565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23594): Terminated: ok {rc=0} 22:41:47.455800 --- ParallelTerminationStrategy: PID 23595 died... 22:41:47.474818 run iperf3-srv_10.42.42.10(pid=23595): Terminated {rc=256} 22:41:47.520068 --- ParallelTerminationStrategy: PID 23598 died... 22:41:47.538923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23598): Terminated: ok {rc=0} 22:41:47.584298 --- ParallelTerminationStrategy: PID 23601 died... 22:41:47.603363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23601): Terminated: ok {rc=0} 22:41:47.648708 --- ParallelTerminationStrategy: PID 23604 died... 22:41:47.668250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23604): Terminated: ok {rc=0} 22:41:47.755794 bus /gobi_0: Setting Powered False 22:41:48.856554 bus /gobi_0: Setting Powered False 22:41:49.974025 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:41:51.121350 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:51.133063 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:41:51.179377 tst iperf3.py: using LAC 17248 22:41:51.299263 tst iperf3.py: using RAC 163 22:41:51.419100 tst iperf3.py: using CellId 17248 22:41:51.545120 tst iperf3.py: using BVCI 17249 22:41:51.656837 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:51.667884 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:51.678715 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:51.689830 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:51.700787 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:51.711706 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:51.722910 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:51.733816 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:51.744780 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:41:51.858298 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:41:52.059304 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:41:52.360538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23606): Launched 22:41:52.622210 run iperf3-srv_10.42.42.10(pid=23607): Launched 22:41:52.735192 tst iperf3.py:8: start network... 22:41:52.936045 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:41:53.402088 run create_hlr_db(pid=23608): Launched 22:41:53.518408 bus /gobi_6: Setting Powered False 22:41:54.578747 run create_hlr_db(pid=23608): Terminated: ok {rc=0} 22:41:55.017465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23610): Launched 22:41:55.339275 run osmo-hlr_10.42.42.2(pid=23611): Launched 22:41:55.462081 run osmo-stp_10.42.42.5: Starting osmo-stp 22:41:56.016007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23613): Launched 22:41:56.335969 run osmo-stp_10.42.42.5(pid=23614): Launched 22:41:56.457633 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:41:57.011771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23616): Launched 22:41:57.134254 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:41:57.404938 run patchelf(pid=23617): Launched 22:41:57.582726 run osmo-stp_10.42.42.5(pid=23614): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23614)] 22:41:57.719278 run osmo-stp_10.42.42.5(pid=23614): stdout: | (launched: 2022-12-08_22:41:56.278108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:57.856881 run osmo-stp_10.42.42.5(pid=23614): stderr: | 20221208224156468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224156468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224156468 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224156469 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224156471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224156471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224156471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:57.995073 run osmo-stp_10.42.42.5(pid=23614): stdout: | (launched: 2022-12-08_22:41:56.278108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:58.127358 run osmo-stp_10.42.42.5(pid=23614): stderr: | 20221208224156468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224156468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224156468 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224156469 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224156471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224156471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224156471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:58.283849 run patchelf(pid=23617): Terminating (SIGINT) 22:41:58.464268 run patchelf(pid=23617): Terminated: ok {rc=0} 22:41:58.594313 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23614): Process ended prematurely: osmo-stp_10.42.42.5(pid=23614) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23614)] [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 22:41:58.604312 tst iperf3.py:8: Test FAILED (7.5 sec) 22:41:58.632917 run osmo-hlr_10.42.42.2(pid=23611): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23611)] 22:41:58.683742 run osmo-hlr_10.42.42.2(pid=23611): stdout: | (launched: 2022-12-08_22:41:55.281065) 22:41:58.736390 run osmo-hlr_10.42.42.2(pid=23611): stderr: | 20221208224155477 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224155477 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224155477 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224155477 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224155477 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224155478 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224155490 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224155499 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224155499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224155499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:41:58.789370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23606): Terminating (SIGTERM) 22:41:58.832011 run iperf3-srv_10.42.42.10(pid=23607): Terminating (SIGTERM) 22:41:58.874568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23610): Terminating (SIGTERM) 22:41:58.917225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23613): Terminating (SIGTERM) 22:41:58.959809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23616): Terminating (SIGTERM) 22:41:59.002617 --- ParallelTerminationStrategy: PID 23606 died... 22:41:59.022887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23606): Terminated: ok {rc=0} 22:41:59.070132 --- ParallelTerminationStrategy: PID 23607 died... 22:41:59.089987 run iperf3-srv_10.42.42.10(pid=23607): Terminated {rc=256} 22:41:59.136652 --- ParallelTerminationStrategy: PID 23610 died... 22:41:59.156565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23610): Terminated: ok {rc=0} 22:41:59.203142 --- ParallelTerminationStrategy: PID 23613 died... 22:41:59.223036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23613): Terminated: ok {rc=0} 22:41:59.269851 --- ParallelTerminationStrategy: PID 23616 died... 22:41:59.289721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23616): Terminated: ok {rc=0} 22:41:59.378711 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:42:00.529834 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:00.542504 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:42:00.590583 tst iperf3m4.py: using LAC 17249 22:42:00.717668 tst iperf3m4.py: using RAC 164 22:42:00.846830 tst iperf3m4.py: using CellId 17249 22:42:01.013275 tst iperf3m4.py: using BVCI 17250 22:42:01.177781 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:01.190072 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:01.202345 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:01.216260 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:01.229089 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:01.242007 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:01.256079 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:01.268187 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:01.280892 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:42:01.406295 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:42:01.525834 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:42:01.642977 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:42:01.765758 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:42:02.006143 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:42:02.341918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23621): Launched 22:42:02.621832 run iperf3-srv_10.42.42.10(pid=23622): Launched 22:42:02.743457 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:42:02.961350 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:42:03.285496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23623): Launched 22:42:03.565466 run iperf3-srv_10.42.42.10(pid=23624): Launched 22:42:03.686798 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:42:03.904844 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:42:04.229164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23625): Launched 22:42:04.508812 run iperf3-srv_10.42.42.10(pid=23626): Launched 22:42:04.629746 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:42:04.846984 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:42:05.169127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23627): Launched 22:42:05.447353 run iperf3-srv_10.42.42.10(pid=23628): Launched 22:42:05.567448 tst iperf3m4.py:8: start network... 22:42:05.784112 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:42:06.281963 run create_hlr_db(pid=23629): Launched 22:42:06.412088 bus /gobi_6: Setting Powered False 22:42:07.476585 run create_hlr_db(pid=23629): Terminated: ok {rc=0} 22:42:07.907232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23631): Launched 22:42:08.208938 run osmo-hlr_10.42.42.2(pid=23632): Launched 22:42:08.323655 run osmo-stp_10.42.42.5: Starting osmo-stp 22:42:08.844815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23634): Launched 22:42:09.146486 run osmo-stp_10.42.42.5(pid=23635): Launched 22:42:09.261865 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:42:09.782316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23637): Launched 22:42:09.897452 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:42:10.153257 run patchelf(pid=23638): Launched 22:42:10.321378 run osmo-stp_10.42.42.5(pid=23635): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23635)] 22:42:10.449665 run osmo-stp_10.42.42.5(pid=23635): stdout: | (launched: 2022-12-08_22:42:09.091312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:10.579419 run osmo-stp_10.42.42.5(pid=23635): stderr: | 20221208224209261 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224209261 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224209261 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224209262 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224209262 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224209262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224209262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:10.709317 run osmo-stp_10.42.42.5(pid=23635): stdout: | (launched: 2022-12-08_22:42:09.091312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:10.833831 run osmo-stp_10.42.42.5(pid=23635): stderr: | 20221208224209261 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224209261 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224209261 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224209262 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224209262 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224209262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224209262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:10.981675 run patchelf(pid=23638): Terminating (SIGINT) 22:42:11.151634 run patchelf(pid=23638): Terminated: ok {rc=0} 22:42:11.273776 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23635): Process ended prematurely: osmo-stp_10.42.42.5(pid=23635) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23635)] [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 22:42:11.283370 tst iperf3m4.py:8: Test FAILED (10.8 sec) 22:42:11.311611 run osmo-hlr_10.42.42.2(pid=23632): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23632)] 22:42:11.360519 run osmo-hlr_10.42.42.2(pid=23632): stdout: | (launched: 2022-12-08_22:42:08.154208) 22:42:11.411228 run osmo-hlr_10.42.42.2(pid=23632): stderr: | 20221208224208329 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224208329 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224208329 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224208329 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224208329 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224208329 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224208342 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224208351 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224208351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224208351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:42:11.462310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23621): Terminating (SIGTERM) 22:42:11.503093 run iperf3-srv_10.42.42.10(pid=23622): Terminating (SIGTERM) 22:42:11.543659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23623): Terminating (SIGTERM) 22:42:11.584369 run iperf3-srv_10.42.42.10(pid=23624): Terminating (SIGTERM) 22:42:11.625013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23625): Terminating (SIGTERM) 22:42:11.665619 run iperf3-srv_10.42.42.10(pid=23626): Terminating (SIGTERM) 22:42:11.706217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23627): Terminating (SIGTERM) 22:42:11.747067 run iperf3-srv_10.42.42.10(pid=23628): Terminating (SIGTERM) 22:42:11.787582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23631): Terminating (SIGTERM) 22:42:11.828678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23634): Terminating (SIGTERM) 22:42:11.869416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23637): Terminating (SIGTERM) 22:42:11.910671 --- ParallelTerminationStrategy: PID 23621 died... 22:42:11.930024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23621): Terminated: ok {rc=0} 22:42:11.975307 --- ParallelTerminationStrategy: PID 23622 died... 22:42:11.994039 run iperf3-srv_10.42.42.10(pid=23622): Terminated {rc=256} 22:42:12.039416 --- ParallelTerminationStrategy: PID 23623 died... 22:42:12.058495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23623): Terminated: ok {rc=0} 22:42:12.104282 --- ParallelTerminationStrategy: PID 23624 died... 22:42:12.123285 run iperf3-srv_10.42.42.10(pid=23624): Terminated {rc=256} 22:42:12.168587 --- ParallelTerminationStrategy: PID 23625 died... 22:42:12.187623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23625): Terminated: ok {rc=0} 22:42:12.233211 --- ParallelTerminationStrategy: PID 23626 died... 22:42:12.252044 run iperf3-srv_10.42.42.10(pid=23626): Terminated {rc=256} 22:42:12.297043 --- ParallelTerminationStrategy: PID 23627 died... 22:42:12.316003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23627): Terminated: ok {rc=0} 22:42:12.361488 --- ParallelTerminationStrategy: PID 23628 died... 22:42:12.380427 run iperf3-srv_10.42.42.10(pid=23628): Terminated {rc=256} 22:42:12.425627 --- ParallelTerminationStrategy: PID 23631 died... 22:42:12.444539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23631): Terminated: ok {rc=0} 22:42:12.489653 --- ParallelTerminationStrategy: PID 23634 died... 22:42:12.508536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23634): Terminated: ok {rc=0} 22:42:12.553745 --- ParallelTerminationStrategy: PID 23637 died... 22:42:12.572687 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23637): Terminated: ok {rc=0} 22:42:12.660416 bus /gobi_4: Setting Powered False 22:42:13.764196 bus /gobi_4: Setting Powered False 22:42:14.884362 bus /gobi_1: Setting Powered False 22:42:15.998694 bus /gobi_1: Setting Powered False 22:42:17.134507 bus /gobi_0: Setting Powered False 22:42:18.245098 bus /gobi_0: Setting Powered False 22:42:19.363079 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 22:42:20.467449 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:20.479291 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:42:20.531018 tst ping.py: using LAC 17250 22:42:20.655576 tst ping.py: using RAC 165 22:42:20.779640 tst ping.py: using CellId 17250 22:42:20.902285 tst ping.py: using BVCI 17251 22:42:21.016797 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:21.028298 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:21.039596 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:21.051188 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:21.062498 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:21.073942 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:21.085360 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:21.096573 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:42:21.213395 tst ping.py:19: start network... 22:42:21.425493 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:42:21.911858 run create_hlr_db(pid=23639): Launched 22:42:22.038270 bus /gobi_6: Setting Powered False 22:42:23.101081 run create_hlr_db(pid=23639): Terminated: ok {rc=0} 22:42:23.524513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23641): Launched 22:42:23.820251 run osmo-hlr_10.42.42.2(pid=23642): Launched 22:42:23.932539 run osmo-stp_10.42.42.5: Starting osmo-stp 22:42:24.464867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23644): Launched 22:42:24.760771 run osmo-stp_10.42.42.5(pid=23645): Launched 22:42:24.873714 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:42:25.383264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23647): Launched 22:42:25.496278 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:42:25.746522 run patchelf(pid=23648): Launched 22:42:25.911452 run osmo-stp_10.42.42.5(pid=23645): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23645)] 22:42:26.037850 run osmo-stp_10.42.42.5(pid=23645): stdout: | (launched: 2022-12-08_22:42:24.707019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:26.166194 run osmo-stp_10.42.42.5(pid=23645): stderr: | 20221208224224874 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224224874 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224224875 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224224875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224224875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224224876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224224876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:26.294535 run osmo-stp_10.42.42.5(pid=23645): stdout: | (launched: 2022-12-08_22:42:24.707019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:26.416505 run osmo-stp_10.42.42.5(pid=23645): stderr: | 20221208224224874 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224224874 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224224875 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224224875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224224875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224224876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224224876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:26.561293 run patchelf(pid=23648): Terminating (SIGINT) 22:42:26.729175 run patchelf(pid=23648): Terminated: ok {rc=0} 22:42:26.849896 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23645): Process ended prematurely: osmo-stp_10.42.42.5(pid=23645) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23645)] [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 22:42:26.858843 tst ping.py:22: Test FAILED (6.4 sec) 22:42:26.886485 run osmo-hlr_10.42.42.2(pid=23642): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23642)] 22:42:26.935275 run osmo-hlr_10.42.42.2(pid=23642): stdout: | (launched: 2022-12-08_22:42:23.765789) 22:42:26.986017 run osmo-hlr_10.42.42.2(pid=23642): stderr: | 20221208224223941 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224223941 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224223941 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224223941 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224223942 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224223942 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224223954 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224223962 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224223962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224223962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:42:27.037192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23641): Terminating (SIGTERM) 22:42:27.077845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23644): Terminating (SIGTERM) 22:42:27.118678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23647): Terminating (SIGTERM) 22:42:27.159630 --- ParallelTerminationStrategy: PID 23641 died... 22:42:27.178901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23641): Terminated: ok {rc=0} 22:42:27.224412 --- ParallelTerminationStrategy: PID 23644 died... 22:42:27.243404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23644): Terminated: ok {rc=0} 22:42:27.289407 --- ParallelTerminationStrategy: PID 23647 died... 22:42:27.308444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23647): Terminated: ok {rc=0} 22:42:27.396323 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:42:28.486353 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:28.498423 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:42:28.546196 tst ping_idle_ping.py: using LAC 17251 22:42:28.664249 tst ping_idle_ping.py: using RAC 166 22:42:28.781408 tst ping_idle_ping.py: using CellId 17251 22:42:28.897823 tst ping_idle_ping.py: using BVCI 17252 22:42:29.008449 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:29.019541 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:29.030415 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:29.041370 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:29.052244 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:29.063237 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:29.074485 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:29.085528 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:42:29.198975 tst ping_idle_ping.py:24: start network... 22:42:29.396930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:42:29.858747 run create_hlr_db(pid=23649): Launched 22:42:29.970955 bus /gobi_6: Setting Powered False 22:42:31.030116 run create_hlr_db(pid=23649): Terminated: ok {rc=0} 22:42:31.455222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23651): Launched 22:42:31.770576 run osmo-hlr_10.42.42.2(pid=23652): Launched 22:42:32.072612 run osmo-stp_10.42.42.5: Starting osmo-stp 22:42:32.762889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23654): Launched 22:42:33.078433 run osmo-stp_10.42.42.5(pid=23655): Launched 22:42:33.198111 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:42:33.743943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23657): Launched 22:42:33.865056 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:42:34.133458 run patchelf(pid=23658): Launched 22:42:34.310575 run osmo-stp_10.42.42.5(pid=23655): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23655)] 22:42:34.445727 run osmo-stp_10.42.42.5(pid=23655): stdout: | (launched: 2022-12-08_22:42:33.021282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:34.582095 run osmo-stp_10.42.42.5(pid=23655): stderr: | 20221208224233212 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224233212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224233213 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224233213 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224233213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224233214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224233214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:34.719180 run osmo-stp_10.42.42.5(pid=23655): stdout: | (launched: 2022-12-08_22:42:33.021282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:34.850048 run osmo-stp_10.42.42.5(pid=23655): stderr: | 20221208224233212 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224233212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224233213 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224233213 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224233213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224233214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224233214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:35.005288 run patchelf(pid=23658): Terminating (SIGINT) 22:42:35.184024 run patchelf(pid=23658): Terminated: ok {rc=0} 22:42:35.313150 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23655): Process ended prematurely: osmo-stp_10.42.42.5(pid=23655) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23655)] [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 22:42:35.322790 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 22:42:35.351138 run osmo-hlr_10.42.42.2(pid=23652): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23652)] 22:42:35.402195 run osmo-hlr_10.42.42.2(pid=23652): stdout: | (launched: 2022-12-08_22:42:31.709432) 22:42:35.454837 run osmo-hlr_10.42.42.2(pid=23652): stderr: | 20221208224231964 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224231964 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224231964 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224231964 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224231964 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224231964 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224231977 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224231993 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224231993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224231993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:42:35.507694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23651): Terminating (SIGTERM) 22:42:35.550161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23654): Terminating (SIGTERM) 22:42:35.592640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23657): Terminating (SIGTERM) 22:42:35.635371 --- ParallelTerminationStrategy: PID 23651 died... 22:42:35.655572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23651): Terminated: ok {rc=0} 22:42:35.703954 --- ParallelTerminationStrategy: PID 23654 died... 22:42:35.723807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23654): Terminated: ok {rc=0} 22:42:35.773092 --- ParallelTerminationStrategy: PID 23657 died... 22:42:35.792923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23657): Terminated: ok {rc=0} 22:42:35.881995 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:42:37.188877 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:42:37.195954 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:42:37.225666 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:42:37.264469 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:42:37.352579 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:42:37.382270 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:42:37.421296 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:42:38.018953 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:42:38.070587 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:38.082015 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:42:38.149225 tst cs_paging_gprs_active.py: using LAC 17252 22:42:38.275866 tst cs_paging_gprs_active.py: using RAC 167 22:42:38.402392 tst cs_paging_gprs_active.py: using CellId 17252 22:42:38.529562 tst cs_paging_gprs_active.py: using BVCI 17253 22:42:38.646241 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:38.657786 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:38.669537 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:38.680824 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:38.692230 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:38.703497 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:38.715036 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:38.726429 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:38.741306 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:42:38.861375 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:42:38.977987 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:42:39.181098 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:42:39.484244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23662): Launched 22:42:39.748239 run iperf3-srv_10.42.42.10(pid=23663): Launched 22:42:39.862268 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:42:40.064899 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:42:40.369484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23664): Launched 22:42:40.634462 run iperf3-srv_10.42.42.10(pid=23665): Launched 22:42:40.748089 tst cs_paging_gprs_active.py:38: start network... 22:42:40.950455 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:42:41.419369 run create_hlr_db(pid=23666): Launched 22:42:41.536353 bus /gobi_6: Setting Powered False 22:42:42.601863 run create_hlr_db(pid=23666): Terminated: ok {rc=0} 22:42:43.051650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23668): Launched 22:42:43.375117 run osmo-hlr_10.42.42.2(pid=23669): Launched 22:42:43.498262 run osmo-stp_10.42.42.5: Starting osmo-stp 22:42:44.053233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23671): Launched 22:42:44.376456 run osmo-stp_10.42.42.5(pid=23672): Launched 22:42:44.499174 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:42:45.056637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23674): Launched 22:42:45.179768 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:42:45.452712 run patchelf(pid=23675): Launched 22:42:45.632132 run osmo-stp_10.42.42.5(pid=23672): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23672)] 22:42:45.769903 run osmo-stp_10.42.42.5(pid=23672): stdout: | (launched: 2022-12-08_22:42:44.317824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:45.915506 run osmo-stp_10.42.42.5(pid=23672): stderr: | 20221208224244509 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224244509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224244509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224244510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224244512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224244512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224244512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:46.058981 run osmo-stp_10.42.42.5(pid=23672): stdout: | (launched: 2022-12-08_22:42:44.317824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:46.194886 run osmo-stp_10.42.42.5(pid=23672): stderr: | 20221208224244509 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224244509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224244509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224244510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224244512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224244512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224244512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:46.356336 run patchelf(pid=23675): Terminating (SIGINT) 22:42:46.540772 run patchelf(pid=23675): Terminated: ok {rc=0} 22:42:46.674965 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23672): Process ended prematurely: osmo-stp_10.42.42.5(pid=23672) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23672)] [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:42:46.686127 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:42:46.717040 run osmo-hlr_10.42.42.2(pid=23669): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23669)] 22:42:46.769199 run osmo-hlr_10.42.42.2(pid=23669): stdout: | (launched: 2022-12-08_22:42:43.316336) 22:42:46.822806 run osmo-hlr_10.42.42.2(pid=23669): stderr: | 20221208224243514 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224243514 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224243515 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224243515 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224243515 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224243515 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224243528 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224243536 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224243536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224243536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:42:46.877568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23662): Terminating (SIGTERM) 22:42:46.921717 run iperf3-srv_10.42.42.10(pid=23663): Terminating (SIGTERM) 22:42:46.967669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23664): Terminating (SIGTERM) 22:42:47.011938 run iperf3-srv_10.42.42.10(pid=23665): Terminating (SIGTERM) 22:42:47.058209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23668): Terminating (SIGTERM) 22:42:47.101918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23671): Terminating (SIGTERM) 22:42:47.145166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23674): Terminating (SIGTERM) 22:42:47.188486 --- ParallelTerminationStrategy: PID 23662 died... 22:42:47.208868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23662): Terminated: ok {rc=0} 22:42:47.255694 --- ParallelTerminationStrategy: PID 23663 died... 22:42:47.275339 run iperf3-srv_10.42.42.10(pid=23663): Terminated {rc=256} 22:42:47.322533 --- ParallelTerminationStrategy: PID 23664 died... 22:42:47.342262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23664): Terminated: ok {rc=0} 22:42:47.388895 --- ParallelTerminationStrategy: PID 23665 died... 22:42:47.408673 run iperf3-srv_10.42.42.10(pid=23665): Terminated {rc=256} 22:42:47.455370 --- ParallelTerminationStrategy: PID 23668 died... 22:42:47.475111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23668): Terminated: ok {rc=0} 22:42:47.521886 --- ParallelTerminationStrategy: PID 23671 died... 22:42:47.541979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23671): Terminated: ok {rc=0} 22:42:47.588759 --- ParallelTerminationStrategy: PID 23674 died... 22:42:47.608569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23674): Terminated: ok {rc=0} 22:42:47.697913 bus /gobi_0: Setting Powered False 22:42:48.798207 bus /gobi_0: Setting Powered False 22:42:49.917103 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:42:51.070319 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:51.082703 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:42:51.155066 tst iperf3.py: using LAC 17253 22:42:51.277088 tst iperf3.py: using RAC 168 22:42:51.402194 tst iperf3.py: using CellId 17253 22:42:51.527258 tst iperf3.py: using BVCI 17254 22:42:51.644823 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:51.656506 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:51.668045 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:51.679974 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:51.691373 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:51.702832 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:51.714436 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:51.725900 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:51.737477 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:42:51.858171 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:42:52.098534 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:42:52.421738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23676): Launched 22:42:52.702994 run iperf3-srv_10.42.42.10(pid=23677): Launched 22:42:52.823771 tst iperf3.py:8: start network... 22:42:53.040455 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:42:53.539556 run create_hlr_db(pid=23678): Launched 22:42:53.670221 bus /gobi_6: Setting Powered False 22:42:54.734626 run create_hlr_db(pid=23678): Terminated: ok {rc=0} 22:42:55.165719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23680): Launched 22:42:55.468904 run osmo-hlr_10.42.42.2(pid=23681): Launched 22:42:55.584651 run osmo-stp_10.42.42.5: Starting osmo-stp 22:42:56.124937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23683): Launched 22:42:56.426588 run osmo-stp_10.42.42.5(pid=23684): Launched 22:42:56.541735 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:42:57.063312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23686): Launched 22:42:57.178893 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:42:57.434488 run patchelf(pid=23687): Launched 22:42:57.603398 run osmo-stp_10.42.42.5(pid=23684): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23684)] 22:42:57.731879 run osmo-stp_10.42.42.5(pid=23684): stdout: | (launched: 2022-12-08_22:42:56.371460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:57.862280 run osmo-stp_10.42.42.5(pid=23684): stderr: | 20221208224256542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224256542 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224256543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224256543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224256544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224256544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224256544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:57.992552 run osmo-stp_10.42.42.5(pid=23684): stdout: | (launched: 2022-12-08_22:42:56.371460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:58.117437 run osmo-stp_10.42.42.5(pid=23684): stderr: | 20221208224256542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224256542 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224256543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224256543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224256544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224256544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224256544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:58.264861 run patchelf(pid=23687): Terminating (SIGINT) 22:42:58.436069 run patchelf(pid=23687): Terminated: ok {rc=0} 22:42:58.558755 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23684): Process ended prematurely: osmo-stp_10.42.42.5(pid=23684) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23684)] [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 22:42:58.568217 tst iperf3.py:8: Test FAILED (7.5 sec) 22:42:58.596233 run osmo-hlr_10.42.42.2(pid=23681): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23681)] 22:42:58.645440 run osmo-hlr_10.42.42.2(pid=23681): stdout: | (launched: 2022-12-08_22:42:55.413940) 22:42:58.696402 run osmo-hlr_10.42.42.2(pid=23681): stderr: | 20221208224255591 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224255591 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224255591 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224255591 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224255591 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224255591 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224255606 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224255617 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224255617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224255617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:42:58.747797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23676): Terminating (SIGTERM) 22:42:58.789223 run iperf3-srv_10.42.42.10(pid=23677): Terminating (SIGTERM) 22:42:58.830107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23680): Terminating (SIGTERM) 22:42:58.870958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23683): Terminating (SIGTERM) 22:42:58.911823 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23686): Terminating (SIGTERM) 22:42:58.952819 --- ParallelTerminationStrategy: PID 23676 died... 22:42:58.972294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23676): Terminated: ok {rc=0} 22:42:59.018085 --- ParallelTerminationStrategy: PID 23677 died... 22:42:59.037254 run iperf3-srv_10.42.42.10(pid=23677): Terminated {rc=256} 22:42:59.083063 --- ParallelTerminationStrategy: PID 23680 died... 22:42:59.102155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23680): Terminated: ok {rc=0} 22:42:59.147637 --- ParallelTerminationStrategy: PID 23683 died... 22:42:59.166666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23683): Terminated: ok {rc=0} 22:42:59.212191 --- ParallelTerminationStrategy: PID 23686 died... 22:42:59.231344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23686): Terminated: ok {rc=0} 22:42:59.319365 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:43:00.467982 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:00.479824 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:43:00.551388 tst iperf3m4.py: using LAC 17254 22:43:00.672888 tst iperf3m4.py: using RAC 169 22:43:00.793215 tst iperf3m4.py: using CellId 17254 22:43:00.939192 tst iperf3m4.py: using BVCI 17255 22:43:01.070648 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:01.083149 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:01.095540 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:01.109643 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:01.121956 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:01.136106 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:01.150197 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:01.163597 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:01.176082 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:43:01.297295 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:43:01.419183 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:43:01.537666 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:43:01.659193 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:43:01.936490 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:43:02.317360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23688): Launched 22:43:02.590785 run iperf3-srv_10.42.42.10(pid=23689): Launched 22:43:02.704742 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:43:02.907437 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:43:03.211064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23690): Launched 22:43:03.474001 run iperf3-srv_10.42.42.10(pid=23691): Launched 22:43:03.588141 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:43:03.790759 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:43:04.095657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23692): Launched 22:43:04.359574 run iperf3-srv_10.42.42.10(pid=23693): Launched 22:43:04.474155 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:43:04.677234 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:43:04.982246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23694): Launched 22:43:05.245173 run iperf3-srv_10.42.42.10(pid=23695): Launched 22:43:05.358632 tst iperf3m4.py:8: start network... 22:43:05.561237 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:43:06.030468 run create_hlr_db(pid=23696): Launched 22:43:06.146158 bus /gobi_6: Setting Powered False 22:43:07.206831 run create_hlr_db(pid=23696): Terminated: ok {rc=0} 22:43:07.628517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23698): Launched 22:43:07.931504 run osmo-hlr_10.42.42.2(pid=23699): Launched 22:43:08.046952 run osmo-stp_10.42.42.5: Starting osmo-stp 22:43:08.583542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23701): Launched 22:43:08.885937 run osmo-stp_10.42.42.5(pid=23702): Launched 22:43:09.000924 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:43:09.523023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23704): Launched 22:43:09.638630 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:43:09.894444 run patchelf(pid=23705): Launched 22:43:10.063022 run osmo-stp_10.42.42.5(pid=23702): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23702)] 22:43:10.191606 run osmo-stp_10.42.42.5(pid=23702): stdout: | (launched: 2022-12-08_22:43:08.830861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:10.321485 run osmo-stp_10.42.42.5(pid=23702): stderr: | 20221208224309001 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224309001 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224309001 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224309001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224309003 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224309004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224309004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:10.451592 run osmo-stp_10.42.42.5(pid=23702): stdout: | (launched: 2022-12-08_22:43:08.830861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:10.577150 run osmo-stp_10.42.42.5(pid=23702): stderr: | 20221208224309001 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224309001 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224309001 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224309001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224309003 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224309004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224309004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:10.725183 run patchelf(pid=23705): Terminating (SIGINT) 22:43:10.895483 run patchelf(pid=23705): Terminated: ok {rc=0} 22:43:11.018411 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23702): Process ended prematurely: osmo-stp_10.42.42.5(pid=23702) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23702)] [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:43:11.027968 tst iperf3m4.py:8: Test FAILED (10.6 sec) 22:43:11.056187 run osmo-hlr_10.42.42.2(pid=23699): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23699)] 22:43:11.105412 run osmo-hlr_10.42.42.2(pid=23699): stdout: | (launched: 2022-12-08_22:43:07.875484) 22:43:11.156485 run osmo-hlr_10.42.42.2(pid=23699): stderr: | 20221208224308050 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224308050 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224308050 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224308050 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224308050 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224308050 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224308060 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224308069 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224308069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224308069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:43:11.207880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23688): Terminating (SIGTERM) 22:43:11.248746 run iperf3-srv_10.42.42.10(pid=23689): Terminating (SIGTERM) 22:43:11.289479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23690): Terminating (SIGTERM) 22:43:11.330334 run iperf3-srv_10.42.42.10(pid=23691): Terminating (SIGTERM) 22:43:11.370934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23692): Terminating (SIGTERM) 22:43:11.411783 run iperf3-srv_10.42.42.10(pid=23693): Terminating (SIGTERM) 22:43:11.452504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23694): Terminating (SIGTERM) 22:43:11.493362 run iperf3-srv_10.42.42.10(pid=23695): Terminating (SIGTERM) 22:43:11.534030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23698): Terminating (SIGTERM) 22:43:11.574789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23701): Terminating (SIGTERM) 22:43:11.615519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23704): Terminating (SIGTERM) 22:43:11.656314 --- ParallelTerminationStrategy: PID 23688 died... 22:43:11.675683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23688): Terminated: ok {rc=0} 22:43:11.721193 --- ParallelTerminationStrategy: PID 23689 died... 22:43:11.740128 run iperf3-srv_10.42.42.10(pid=23689): Terminated {rc=256} 22:43:11.785383 --- ParallelTerminationStrategy: PID 23690 died... 22:43:11.804294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23690): Terminated: ok {rc=0} 22:43:11.849591 --- ParallelTerminationStrategy: PID 23691 died... 22:43:11.868454 run iperf3-srv_10.42.42.10(pid=23691): Terminated {rc=256} 22:43:11.913567 --- ParallelTerminationStrategy: PID 23692 died... 22:43:11.932654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23692): Terminated: ok {rc=0} 22:43:11.977894 --- ParallelTerminationStrategy: PID 23693 died... 22:43:11.996782 run iperf3-srv_10.42.42.10(pid=23693): Terminated {rc=256} 22:43:12.042133 --- ParallelTerminationStrategy: PID 23694 died... 22:43:12.061185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23694): Terminated: ok {rc=0} 22:43:12.106802 --- ParallelTerminationStrategy: PID 23695 died... 22:43:12.125830 run iperf3-srv_10.42.42.10(pid=23695): Terminated {rc=256} 22:43:12.171194 --- ParallelTerminationStrategy: PID 23698 died... 22:43:12.190235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23698): Terminated: ok {rc=0} 22:43:12.235719 --- ParallelTerminationStrategy: PID 23701 died... 22:43:12.254764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23701): Terminated: ok {rc=0} 22:43:12.300745 --- ParallelTerminationStrategy: PID 23704 died... 22:43:12.319929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23704): Terminated: ok {rc=0} 22:43:12.406812 bus /gobi_4: Setting Powered False 22:43:13.507924 bus /gobi_4: Setting Powered False 22:43:14.626094 bus /gobi_1: Setting Powered False 22:43:15.726049 bus /gobi_1: Setting Powered False 22:43:16.846540 bus /gobi_0: Setting Powered False 22:43:17.946227 bus /gobi_0: Setting Powered False 22:43:19.064352 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:43:20.169126 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:20.181498 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:43:20.254016 tst ping.py: using LAC 17255 22:43:20.380708 tst ping.py: using RAC 170 22:43:20.507365 tst ping.py: using CellId 17255 22:43:20.632196 tst ping.py: using BVCI 17256 22:43:20.747275 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:20.758907 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:20.770228 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:20.781668 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:20.792897 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:20.804508 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:20.815971 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:20.827443 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:43:20.941458 tst ping.py:19: start network... 22:43:21.154553 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:43:21.643504 run create_hlr_db(pid=23706): Launched 22:43:21.771443 bus /gobi_6: Setting Powered False 22:43:22.834285 run create_hlr_db(pid=23706): Terminated: ok {rc=0} 22:43:23.257914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23708): Launched 22:43:23.553762 run osmo-hlr_10.42.42.2(pid=23709): Launched 22:43:23.667086 run osmo-stp_10.42.42.5: Starting osmo-stp 22:43:24.216766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23711): Launched 22:43:24.532232 run osmo-stp_10.42.42.5(pid=23712): Launched 22:43:24.648320 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:43:25.163035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23714): Launched 22:43:25.277350 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:43:25.528912 run patchelf(pid=23715): Launched 22:43:25.694585 run osmo-stp_10.42.42.5(pid=23712): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23712)] 22:43:25.822077 run osmo-stp_10.42.42.5(pid=23712): stdout: | (launched: 2022-12-08_22:43:24.474817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:25.950453 run osmo-stp_10.42.42.5(pid=23712): stderr: | 20221208224324646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224324646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224324646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224324647 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224324647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224324647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224324647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:26.079302 run osmo-stp_10.42.42.5(pid=23712): stdout: | (launched: 2022-12-08_22:43:24.474817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:26.202848 run osmo-stp_10.42.42.5(pid=23712): stderr: | 20221208224324646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224324646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224324646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224324647 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224324647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224324647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224324647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:26.348189 run patchelf(pid=23715): Terminating (SIGINT) 22:43:26.516488 run patchelf(pid=23715): Terminated: ok {rc=0} 22:43:26.639059 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23712): Process ended prematurely: osmo-stp_10.42.42.5(pid=23712) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23712)] [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 22:43:26.648122 tst ping.py:22: Test FAILED (6.5 sec) 22:43:26.675823 run osmo-hlr_10.42.42.2(pid=23709): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23709)] 22:43:26.725346 run osmo-hlr_10.42.42.2(pid=23709): stdout: | (launched: 2022-12-08_22:43:23.499574) 22:43:26.776444 run osmo-hlr_10.42.42.2(pid=23709): stderr: | 20221208224323675 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224323675 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224323675 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224323675 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224323675 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224323675 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224323688 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224323698 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224323698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224323699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:43:26.828000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23708): Terminating (SIGTERM) 22:43:26.869054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23711): Terminating (SIGTERM) 22:43:26.910072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23714): Terminating (SIGTERM) 22:43:26.951405 --- ParallelTerminationStrategy: PID 23708 died... 22:43:26.970872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23708): Terminated: ok {rc=0} 22:43:27.016679 --- ParallelTerminationStrategy: PID 23711 died... 22:43:27.035582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23711): Terminated: ok {rc=0} 22:43:27.081523 --- ParallelTerminationStrategy: PID 23714 died... 22:43:27.100438 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23714): Terminated: ok {rc=0} 22:43:27.185927 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:43:28.273652 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:28.286004 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:43:28.354232 tst ping_idle_ping.py: using LAC 17256 22:43:28.480292 tst ping_idle_ping.py: using RAC 171 22:43:28.606800 tst ping_idle_ping.py: using CellId 17256 22:43:28.732011 tst ping_idle_ping.py: using BVCI 17257 22:43:28.842137 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:28.853387 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:28.864346 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:28.875732 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:28.887046 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:28.898512 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:28.910614 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:28.921547 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:43:29.040336 tst ping_idle_ping.py:24: start network... 22:43:29.252532 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:43:29.744416 run create_hlr_db(pid=23716): Launched 22:43:29.873614 bus /gobi_6: Setting Powered False 22:43:30.941920 run create_hlr_db(pid=23716): Terminated: ok {rc=0} 22:43:31.379732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23718): Launched 22:43:31.711606 run osmo-hlr_10.42.42.2(pid=23719): Launched 22:43:31.885827 run osmo-stp_10.42.42.5: Starting osmo-stp 22:43:32.547389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23721): Launched 22:43:32.846245 run osmo-stp_10.42.42.5(pid=23722): Launched 22:43:32.959332 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:43:33.474309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23724): Launched 22:43:33.588644 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:43:33.842503 run patchelf(pid=23725): Launched 22:43:34.009707 run osmo-stp_10.42.42.5(pid=23722): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23722)] 22:43:34.137287 run osmo-stp_10.42.42.5(pid=23722): stdout: | (launched: 2022-12-08_22:43:32.791858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:34.265884 run osmo-stp_10.42.42.5(pid=23722): stderr: | 20221208224332962 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224332962 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224332962 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224332963 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224332963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224332963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224332963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:34.394944 run osmo-stp_10.42.42.5(pid=23722): stdout: | (launched: 2022-12-08_22:43:32.791858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:34.517936 run osmo-stp_10.42.42.5(pid=23722): stderr: | 20221208224332962 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224332962 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224332962 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224332963 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224332963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224332963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224332963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:34.663643 run patchelf(pid=23725): Terminating (SIGINT) 22:43:34.832661 run patchelf(pid=23725): Terminated: ok {rc=0} 22:43:34.954533 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23722): Process ended prematurely: osmo-stp_10.42.42.5(pid=23722) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23722)] [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:43:34.963454 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 22:43:34.991073 run osmo-hlr_10.42.42.2(pid=23719): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23719)] 22:43:35.040016 run osmo-hlr_10.42.42.2(pid=23719): stdout: | (launched: 2022-12-08_22:43:31.650844) 22:43:35.090741 run osmo-hlr_10.42.42.2(pid=23719): stderr: | 20221208224331989 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224331989 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224331989 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224331989 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224331989 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224331989 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224332007 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224332023 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224332024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224332024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:43:35.142026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23718): Terminating (SIGTERM) 22:43:35.183049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23721): Terminating (SIGTERM) 22:43:35.223771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23724): Terminating (SIGTERM) 22:43:35.264722 --- ParallelTerminationStrategy: PID 23718 died... 22:43:35.284205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23718): Terminated: ok {rc=0} 22:43:35.329803 --- ParallelTerminationStrategy: PID 23721 died... 22:43:35.348820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23721): Terminated: ok {rc=0} 22:43:35.394154 --- ParallelTerminationStrategy: PID 23724 died... 22:43:35.413209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23724): Terminated: ok {rc=0} 22:43:35.500480 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:43:36.800779 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:43:36.807163 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:43:36.838676 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 22:43:36.877333 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 22:43:36.963249 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:43:36.992386 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 22:43:37.030821 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 22:43:37.625522 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 22:43:37.679510 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:37.691267 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:43:37.758841 tst cs_paging_gprs_active.py: using LAC 17257 22:43:37.887026 tst cs_paging_gprs_active.py: using RAC 172 22:43:38.018433 tst cs_paging_gprs_active.py: using CellId 17257 22:43:38.145307 tst cs_paging_gprs_active.py: using BVCI 17258 22:43:38.262459 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:38.274328 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:38.285642 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:38.296895 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:38.308200 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:38.319601 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:38.330951 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:38.342167 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:38.353867 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:43:38.471224 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:43:38.593407 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:43:38.812831 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:43:39.136698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23729): Launched 22:43:39.417364 run iperf3-srv_10.42.42.10(pid=23730): Launched 22:43:39.538378 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:43:39.755960 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:43:40.078998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23731): Launched 22:43:40.359701 run iperf3-srv_10.42.42.10(pid=23732): Launched 22:43:40.481153 tst cs_paging_gprs_active.py:38: start network... 22:43:40.698820 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:43:41.201003 run create_hlr_db(pid=23733): Launched 22:43:41.323744 bus /gobi_6: Setting Powered False 22:43:42.384086 run create_hlr_db(pid=23733): Terminated: ok {rc=0} 22:43:42.826753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23735): Launched 22:43:43.150488 run osmo-hlr_10.42.42.2(pid=23736): Launched 22:43:43.273654 run osmo-stp_10.42.42.5: Starting osmo-stp 22:43:43.829919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23738): Launched 22:43:44.152833 run osmo-stp_10.42.42.5(pid=23739): Launched 22:43:44.275475 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:43:44.834483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23741): Launched 22:43:44.957954 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:43:45.238093 run patchelf(pid=23742): Launched 22:43:45.418464 run osmo-stp_10.42.42.5(pid=23739): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23739)] 22:43:45.555892 run osmo-stp_10.42.42.5(pid=23739): stdout: | (launched: 2022-12-08_22:43:44.094262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:45.695031 run osmo-stp_10.42.42.5(pid=23739): stderr: | 20221208224344287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224344288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224344288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224344288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224344289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224344289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224344289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:45.834861 run osmo-stp_10.42.42.5(pid=23739): stdout: | (launched: 2022-12-08_22:43:44.094262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:45.988225 run osmo-stp_10.42.42.5(pid=23739): stderr: | 20221208224344287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224344288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224344288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224344288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224344289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224344289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224344289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:46.147111 run patchelf(pid=23742): Terminating (SIGINT) 22:43:46.322447 run patchelf(pid=23742): Terminated: ok {rc=0} 22:43:46.452004 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23739): Process ended prematurely: osmo-stp_10.42.42.5(pid=23739) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23739)] [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 22:43:46.462938 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 22:43:46.494529 run osmo-hlr_10.42.42.2(pid=23736): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23736)] 22:43:46.547353 run osmo-hlr_10.42.42.2(pid=23736): stdout: | (launched: 2022-12-08_22:43:43.091558) 22:43:46.601339 run osmo-hlr_10.42.42.2(pid=23736): stderr: | 20221208224343289 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224343290 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224343290 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224343290 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224343290 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224343290 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224343306 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224343316 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224343316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224343316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:43:46.656327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23729): Terminating (SIGTERM) 22:43:46.700571 run iperf3-srv_10.42.42.10(pid=23730): Terminating (SIGTERM) 22:43:46.747900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23731): Terminating (SIGTERM) 22:43:46.792648 run iperf3-srv_10.42.42.10(pid=23732): Terminating (SIGTERM) 22:43:46.838911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23735): Terminating (SIGTERM) 22:43:46.883524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23738): Terminating (SIGTERM) 22:43:46.928760 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23741): Terminating (SIGTERM) 22:43:46.975569 --- ParallelTerminationStrategy: PID 23729 died... 22:43:46.997108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23729): Terminated: ok {rc=0} 22:43:47.046987 --- ParallelTerminationStrategy: PID 23730 died... 22:43:47.066916 run iperf3-srv_10.42.42.10(pid=23730): Terminated {rc=256} 22:43:47.115060 --- ParallelTerminationStrategy: PID 23731 died... 22:43:47.136475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23731): Terminated: ok {rc=0} 22:43:47.184819 --- ParallelTerminationStrategy: PID 23732 died... 22:43:47.204460 run iperf3-srv_10.42.42.10(pid=23732): Terminated {rc=256} 22:43:47.249975 --- ParallelTerminationStrategy: PID 23735 died... 22:43:47.269170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23735): Terminated: ok {rc=0} 22:43:47.314548 --- ParallelTerminationStrategy: PID 23738 died... 22:43:47.333648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23738): Terminated: ok {rc=0} 22:43:47.379346 --- ParallelTerminationStrategy: PID 23741 died... 22:43:47.398640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23741): Terminated: ok {rc=0} 22:43:47.486631 bus /gobi_0: Setting Powered False 22:43:48.585750 bus /gobi_0: Setting Powered False 22:43:49.702348 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 22:43:50.848627 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:50.860324 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:43:50.926220 tst iperf3.py: using LAC 17258 22:43:51.046294 tst iperf3.py: using RAC 173 22:43:51.167335 tst iperf3.py: using CellId 17258 22:43:51.288200 tst iperf3.py: using BVCI 17259 22:43:51.398404 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:51.409476 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:51.420214 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:51.431417 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:51.442772 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:51.453757 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:51.464852 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:51.475870 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:51.487096 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:43:51.601486 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:43:51.804336 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:43:52.108503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23743): Launched 22:43:52.371656 run iperf3-srv_10.42.42.10(pid=23744): Launched 22:43:52.485320 tst iperf3.py:8: start network... 22:43:52.686998 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:43:53.155468 run create_hlr_db(pid=23745): Launched 22:43:53.272898 bus /gobi_6: Setting Powered False 22:43:54.333794 run create_hlr_db(pid=23745): Terminated: ok {rc=0} 22:43:54.778668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23747): Launched 22:43:55.103172 run osmo-hlr_10.42.42.2(pid=23748): Launched 22:43:55.226037 run osmo-stp_10.42.42.5: Starting osmo-stp 22:43:55.787875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23750): Launched 22:43:56.111616 run osmo-stp_10.42.42.5(pid=23751): Launched 22:43:56.234780 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:43:56.793316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23753): Launched 22:43:56.916775 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:43:57.189039 run patchelf(pid=23754): Launched 22:43:57.369093 run osmo-stp_10.42.42.5(pid=23751): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23751)] 22:43:57.506427 run osmo-stp_10.42.42.5(pid=23751): stdout: | (launched: 2022-12-08_22:43:56.052728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:57.655840 run osmo-stp_10.42.42.5(pid=23751): stderr: | 20221208224356244 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224356244 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224356244 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224356245 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224356245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224356245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224356245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:57.795450 run osmo-stp_10.42.42.5(pid=23751): stdout: | (launched: 2022-12-08_22:43:56.052728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:57.928668 run osmo-stp_10.42.42.5(pid=23751): stderr: | 20221208224356244 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224356244 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224356244 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224356245 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224356245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224356245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224356245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:58.086699 run patchelf(pid=23754): Terminating (SIGINT) 22:43:58.268221 run patchelf(pid=23754): Terminated: ok {rc=0} 22:43:58.399755 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23751): Process ended prematurely: osmo-stp_10.42.42.5(pid=23751) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23751)] [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 22:43:58.410006 tst iperf3.py:8: Test FAILED (7.6 sec) 22:43:58.439075 run osmo-hlr_10.42.42.2(pid=23748): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23748)] 22:43:58.490122 run osmo-hlr_10.42.42.2(pid=23748): stdout: | (launched: 2022-12-08_22:43:55.044645) 22:43:58.543166 run osmo-hlr_10.42.42.2(pid=23748): stderr: | 20221208224355244 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224355244 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224355244 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224355244 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224355244 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224355244 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224355257 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224355265 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224355265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224355265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:43:58.596356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23743): Terminating (SIGTERM) 22:43:58.638953 run iperf3-srv_10.42.42.10(pid=23744): Terminating (SIGTERM) 22:43:58.681546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23747): Terminating (SIGTERM) 22:43:58.724473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23750): Terminating (SIGTERM) 22:43:58.767236 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23753): Terminating (SIGTERM) 22:43:58.809902 --- ParallelTerminationStrategy: PID 23743 died... 22:43:58.830226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23743): Terminated: ok {rc=0} 22:43:58.877691 --- ParallelTerminationStrategy: PID 23744 died... 22:43:58.897807 run iperf3-srv_10.42.42.10(pid=23744): Terminated {rc=256} 22:43:58.944684 --- ParallelTerminationStrategy: PID 23747 died... 22:43:58.964620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23747): Terminated: ok {rc=0} 22:43:59.011627 --- ParallelTerminationStrategy: PID 23750 died... 22:43:59.031583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23750): Terminated: ok {rc=0} 22:43:59.078761 --- ParallelTerminationStrategy: PID 23753 died... 22:43:59.098790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23753): Terminated: ok {rc=0} 22:43:59.187804 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 22:44:00.338515 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:00.350823 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:44:00.423858 tst iperf3m4.py: using LAC 17259 22:44:00.560014 tst iperf3m4.py: using RAC 174 22:44:00.686293 tst iperf3m4.py: using CellId 17259 22:44:00.812230 tst iperf3m4.py: using BVCI 17260 22:44:00.947998 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:00.960053 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:00.971955 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:00.986179 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:00.998997 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:01.011485 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:01.025714 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:01.038823 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:01.051035 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:44:01.171402 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:44:01.294866 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:44:01.421682 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:44:01.568807 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:44:01.789991 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:44:02.185751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23755): Launched 22:44:02.461558 run iperf3-srv_10.42.42.10(pid=23756): Launched 22:44:02.576813 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:44:02.781528 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:44:03.087530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23757): Launched 22:44:03.351385 run iperf3-srv_10.42.42.10(pid=23758): Launched 22:44:03.465551 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:44:03.668376 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:44:03.973472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23759): Launched 22:44:04.238247 run iperf3-srv_10.42.42.10(pid=23760): Launched 22:44:04.352368 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:44:04.555009 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:44:04.859537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23761): Launched 22:44:05.123281 run iperf3-srv_10.42.42.10(pid=23762): Launched 22:44:05.237080 tst iperf3m4.py:8: start network... 22:44:05.439372 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:44:05.909150 run create_hlr_db(pid=23763): Launched 22:44:06.025357 bus /gobi_6: Setting Powered False 22:44:07.086577 run create_hlr_db(pid=23763): Terminated: ok {rc=0} 22:44:07.509477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23765): Launched 22:44:07.814410 run osmo-hlr_10.42.42.2(pid=23766): Launched 22:44:07.930112 run osmo-stp_10.42.42.5: Starting osmo-stp 22:44:08.451761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23768): Launched 22:44:08.756257 run osmo-stp_10.42.42.5(pid=23769): Launched 22:44:08.871340 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:44:09.394309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23771): Launched 22:44:09.510650 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:44:09.767756 run patchelf(pid=23772): Launched 22:44:09.936791 run osmo-stp_10.42.42.5(pid=23769): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23769)] 22:44:10.065584 run osmo-stp_10.42.42.5(pid=23769): stdout: | (launched: 2022-12-08_22:44:08.700083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:10.196027 run osmo-stp_10.42.42.5(pid=23769): stderr: | 20221208224408870 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224408870 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224408870 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224408871 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224408871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224408871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224408871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:10.326188 run osmo-stp_10.42.42.5(pid=23769): stdout: | (launched: 2022-12-08_22:44:08.700083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:10.451415 run osmo-stp_10.42.42.5(pid=23769): stderr: | 20221208224408870 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224408870 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224408870 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224408871 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224408871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224408871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224408871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:10.599310 run patchelf(pid=23772): Terminating (SIGINT) 22:44:10.770655 run patchelf(pid=23772): Terminated: ok {rc=0} 22:44:10.893447 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23769): Process ended prematurely: osmo-stp_10.42.42.5(pid=23769) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23769)] [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 22:44:10.903020 tst iperf3m4.py:8: Test FAILED (10.6 sec) 22:44:10.931613 run osmo-hlr_10.42.42.2(pid=23766): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23766)] 22:44:10.980718 run osmo-hlr_10.42.42.2(pid=23766): stdout: | (launched: 2022-12-08_22:44:07.758835) 22:44:11.031547 run osmo-hlr_10.42.42.2(pid=23766): stderr: | 20221208224407937 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224407937 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224407937 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224407937 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224407937 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224407937 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224407978 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224407987 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224407988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224407988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:44:11.082904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23755): Terminating (SIGTERM) 22:44:11.123966 run iperf3-srv_10.42.42.10(pid=23756): Terminating (SIGTERM) 22:44:11.164846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23757): Terminating (SIGTERM) 22:44:11.205641 run iperf3-srv_10.42.42.10(pid=23758): Terminating (SIGTERM) 22:44:11.246391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23759): Terminating (SIGTERM) 22:44:11.287094 run iperf3-srv_10.42.42.10(pid=23760): Terminating (SIGTERM) 22:44:11.327778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23761): Terminating (SIGTERM) 22:44:11.369092 run iperf3-srv_10.42.42.10(pid=23762): Terminating (SIGTERM) 22:44:11.409733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23765): Terminating (SIGTERM) 22:44:11.450454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23768): Terminating (SIGTERM) 22:44:11.491143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23771): Terminating (SIGTERM) 22:44:11.532132 --- ParallelTerminationStrategy: PID 23755 died... 22:44:11.551692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23755): Terminated: ok {rc=0} 22:44:11.597556 --- ParallelTerminationStrategy: PID 23756 died... 22:44:11.616454 run iperf3-srv_10.42.42.10(pid=23756): Terminated {rc=256} 22:44:11.661969 --- ParallelTerminationStrategy: PID 23757 died... 22:44:11.681066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23757): Terminated: ok {rc=0} 22:44:11.726420 --- ParallelTerminationStrategy: PID 23758 died... 22:44:11.745502 run iperf3-srv_10.42.42.10(pid=23758): Terminated {rc=256} 22:44:11.790993 --- ParallelTerminationStrategy: PID 23759 died... 22:44:11.810090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23759): Terminated: ok {rc=0} 22:44:11.855544 --- ParallelTerminationStrategy: PID 23760 died... 22:44:11.874687 run iperf3-srv_10.42.42.10(pid=23760): Terminated {rc=256} 22:44:11.920265 --- ParallelTerminationStrategy: PID 23761 died... 22:44:11.939467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23761): Terminated: ok {rc=0} 22:44:11.984888 --- ParallelTerminationStrategy: PID 23762 died... 22:44:12.003892 run iperf3-srv_10.42.42.10(pid=23762): Terminated {rc=256} 22:44:12.049881 --- ParallelTerminationStrategy: PID 23765 died... 22:44:12.068914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23765): Terminated: ok {rc=0} 22:44:12.114522 --- ParallelTerminationStrategy: PID 23768 died... 22:44:12.133915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23768): Terminated: ok {rc=0} 22:44:12.179422 --- ParallelTerminationStrategy: PID 23771 died... 22:44:12.198556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23771): Terminated: ok {rc=0} 22:44:12.286689 bus /gobi_4: Setting Powered False 22:44:13.386854 bus /gobi_4: Setting Powered False 22:44:14.504456 bus /gobi_1: Setting Powered False 22:44:15.604505 bus /gobi_1: Setting Powered False 22:44:16.717010 bus /gobi_0: Setting Powered False 22:44:17.814691 bus /gobi_0: Setting Powered False 22:44:18.929255 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 22:44:20.034126 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:20.046801 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:44:20.117280 tst ping.py: using LAC 17260 22:44:20.242607 tst ping.py: using RAC 175 22:44:20.371830 tst ping.py: using CellId 17260 22:44:20.498141 tst ping.py: using BVCI 17261 22:44:20.614667 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:20.626370 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:20.637790 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:20.649375 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:20.660828 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:20.672449 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:20.684081 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:20.695731 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:44:20.812816 tst ping.py:19: start network... 22:44:21.025789 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:44:21.515205 run create_hlr_db(pid=23773): Launched 22:44:21.644280 bus /gobi_6: Setting Powered False 22:44:22.707748 run create_hlr_db(pid=23773): Terminated: ok {rc=0} 22:44:23.150561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23775): Launched 22:44:23.466562 run osmo-hlr_10.42.42.2(pid=23776): Launched 22:44:23.586478 run osmo-stp_10.42.42.5: Starting osmo-stp 22:44:24.134041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23778): Launched 22:44:24.450273 run osmo-stp_10.42.42.5(pid=23779): Launched 22:44:24.570746 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:44:25.119372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23781): Launched 22:44:25.241144 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:44:25.509406 run patchelf(pid=23782): Launched 22:44:25.687447 run osmo-stp_10.42.42.5(pid=23779): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23779)] 22:44:25.824106 run osmo-stp_10.42.42.5(pid=23779): stdout: | (launched: 2022-12-08_22:44:24.392562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:25.961815 run osmo-stp_10.42.42.5(pid=23779): stderr: | 20221208224424583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224424584 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224424584 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224424584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224424586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224424587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224424587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:26.099354 run osmo-stp_10.42.42.5(pid=23779): stdout: | (launched: 2022-12-08_22:44:24.392562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:26.231030 run osmo-stp_10.42.42.5(pid=23779): stderr: | 20221208224424583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224424584 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224424584 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224424584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224424586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224424587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224424587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:26.386990 run patchelf(pid=23782): Terminating (SIGINT) 22:44:26.566740 run patchelf(pid=23782): Terminated: ok {rc=0} 22:44:26.696453 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23779): Process ended prematurely: osmo-stp_10.42.42.5(pid=23779) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23779)] [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 22:44:26.706403 tst ping.py:22: Test FAILED (6.7 sec) 22:44:26.735387 run osmo-hlr_10.42.42.2(pid=23776): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23776)] 22:44:26.786717 run osmo-hlr_10.42.42.2(pid=23776): stdout: | (launched: 2022-12-08_22:44:23.409287) 22:44:26.839840 run osmo-hlr_10.42.42.2(pid=23776): stderr: | 20221208224423606 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224423606 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224423606 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224423606 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224423606 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224423607 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224423620 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224423628 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224423628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224423628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:44:26.893207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23775): Terminating (SIGTERM) 22:44:26.935855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23778): Terminating (SIGTERM) 22:44:26.978677 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23781): Terminating (SIGTERM) 22:44:27.021667 --- ParallelTerminationStrategy: PID 23775 died... 22:44:27.042051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23775): Terminated: ok {rc=0} 22:44:27.089910 --- ParallelTerminationStrategy: PID 23778 died... 22:44:27.110161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23778): Terminated: ok {rc=0} 22:44:27.157317 --- ParallelTerminationStrategy: PID 23781 died... 22:44:27.177249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23781): Terminated: ok {rc=0} 22:44:27.266363 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 22:44:28.356400 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:28.369285 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:44:28.443841 tst ping_idle_ping.py: using LAC 17261 22:44:28.569798 tst ping_idle_ping.py: using RAC 176 22:44:28.696394 tst ping_idle_ping.py: using CellId 17261 22:44:28.823725 tst ping_idle_ping.py: using BVCI 17262 22:44:28.939499 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:28.951215 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:28.962596 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:28.974217 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:28.985749 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:28.997380 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:29.008897 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:29.020442 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:44:29.139436 tst ping_idle_ping.py:24: start network... 22:44:29.354465 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:44:29.848633 run create_hlr_db(pid=23783): Launched 22:44:29.977682 bus /gobi_6: Setting Powered False 22:44:31.058230 run create_hlr_db(pid=23783): Terminated: ok {rc=0} 22:44:31.548713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23785): Launched 22:44:31.868917 run osmo-hlr_10.42.42.2(pid=23786): Launched 22:44:32.103598 run osmo-stp_10.42.42.5: Starting osmo-stp 22:44:32.716538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23788): Launched 22:44:33.034128 run osmo-stp_10.42.42.5(pid=23789): Launched 22:44:33.155452 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:44:33.704339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23791): Launched 22:44:33.826719 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:44:34.095587 run patchelf(pid=23792): Launched 22:44:34.272735 run osmo-stp_10.42.42.5(pid=23789): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23789)] 22:44:34.408401 run osmo-stp_10.42.42.5(pid=23789): stdout: | (launched: 2022-12-08_22:44:32.976230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:34.545180 run osmo-stp_10.42.42.5(pid=23789): stderr: | 20221208224433167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224433167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224433167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224433168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224433168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224433168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224433168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:34.682254 run osmo-stp_10.42.42.5(pid=23789): stdout: | (launched: 2022-12-08_22:44:32.976230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:34.813994 run osmo-stp_10.42.42.5(pid=23789): stderr: | 20221208224433167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224433167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224433167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224433168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224433168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224433168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224433168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:34.969226 run patchelf(pid=23792): Terminating (SIGINT) 22:44:35.148664 run patchelf(pid=23792): Terminated: ok {rc=0} 22:44:35.277972 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23789): Process ended prematurely: osmo-stp_10.42.42.5(pid=23789) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23789)] [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 22:44:35.287572 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 22:44:35.316109 run osmo-hlr_10.42.42.2(pid=23786): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23786)] 22:44:35.366882 run osmo-hlr_10.42.42.2(pid=23786): stdout: | (launched: 2022-12-08_22:44:31.810653) 22:44:35.419347 run osmo-hlr_10.42.42.2(pid=23786): stderr: | 20221208224432155 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224432155 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224432155 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224432155 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224432155 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224432155 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224432175 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224432184 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224432184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224432191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:44:35.472444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23785): Terminating (SIGTERM) 22:44:35.514916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23788): Terminating (SIGTERM) 22:44:35.557303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23791): Terminating (SIGTERM) 22:44:35.599955 --- ParallelTerminationStrategy: PID 23785 died... 22:44:35.620289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23785): Terminated: ok {rc=0} 22:44:35.667716 --- ParallelTerminationStrategy: PID 23788 died... 22:44:35.687621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23788): Terminated: ok {rc=0} 22:44:35.734900 --- ParallelTerminationStrategy: PID 23791 died... 22:44:35.754865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23791): Terminated: ok {rc=0} 22:44:35.843518 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:44:37.152229 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:44:37.159710 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:44:37.190225 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:44:37.225601 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:44:37.279195 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:44:37.308589 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:44:37.343654 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:44:37.905664 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2350 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:44:37.910851 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:44:37.922721 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:44:37.989510 tst switch_tch_pdch.py: using LAC 17262 22:44:38.113766 tst switch_tch_pdch.py: using RAC 177 22:44:38.239244 tst switch_tch_pdch.py: using CellId 17262 22:44:38.364204 tst switch_tch_pdch.py: using BVCI 17263 22:44:38.479684 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:44:38.491429 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:44:38.503114 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:44:38.514761 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:44:38.526425 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:44:38.538118 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:44:38.549867 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:44:38.561514 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:44:38.681655 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:44:38.801217 tst switch_tch_pdch.py:51: start network... 22:44:39.013664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:44:39.504559 run create_hlr_db(pid=23797): Launched 22:44:39.633179 bus /gobi_6: Setting Powered False 22:44:40.696766 run create_hlr_db(pid=23797): Terminated: ok {rc=0} 22:44:41.124384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23799): Launched 22:44:41.423218 run osmo-hlr_10.42.42.2(pid=23800): Launched 22:44:41.536544 run osmo-stp_10.42.42.5: Starting osmo-stp 22:44:42.047779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23802): Launched 22:44:42.344210 run osmo-stp_10.42.42.5(pid=23803): Launched 22:44:42.456884 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:44:42.969420 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23805): Launched 22:44:43.084209 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:44:43.337413 run patchelf(pid=23806): Launched 22:44:43.504127 run osmo-stp_10.42.42.5(pid=23803): ERR: Terminated: ERROR {rc=1} [trial-2350↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23803)] 22:44:43.631810 run osmo-stp_10.42.42.5(pid=23803): stdout: | (launched: 2022-12-08_22:44:42.289965) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:43.760674 run osmo-stp_10.42.42.5(pid=23803): stderr: | 20221208224442458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224442459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224442459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224442459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224442460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224442460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224442460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:43.889863 run osmo-stp_10.42.42.5(pid=23803): stdout: | (launched: 2022-12-08_22:44:42.289965) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:44.012852 run osmo-stp_10.42.42.5(pid=23803): stderr: | 20221208224442458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224442459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224442459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224442459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224442460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224442460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224442460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:44.158741 run patchelf(pid=23806): Terminating (SIGINT) 22:44:44.327587 run patchelf(pid=23806): Terminated: ok {rc=0} 22:44:44.449528 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23803): Process ended prematurely: osmo-stp_10.42.42.5(pid=23803) [trial-2350↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23803)] [trial-2350↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:44:44.458828 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 22:44:44.486253 run osmo-hlr_10.42.42.2(pid=23800): ERR: Terminated: ERROR {rc=237} [trial-2350↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23800)] 22:44:44.535304 run osmo-hlr_10.42.42.2(pid=23800): stdout: | (launched: 2022-12-08_22:44:41.368847) 22:44:44.586145 run osmo-hlr_10.42.42.2(pid=23800): stderr: | 20221208224441544 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224441544 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224441544 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224441544 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224441544 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224441544 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224441574 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224441585 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224441585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224441585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:44:44.637312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23799): Terminating (SIGTERM) 22:44:44.678146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23802): Terminating (SIGTERM) 22:44:44.719092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23805): Terminating (SIGTERM) 22:44:44.760194 --- ParallelTerminationStrategy: PID 23799 died... 22:44:44.779692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23799): Terminated: ok {rc=0} 22:44:44.825445 --- ParallelTerminationStrategy: PID 23802 died... 22:44:44.844318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23802): Terminated: ok {rc=0} 22:44:44.890031 --- ParallelTerminationStrategy: PID 23805 died... 22:44:44.908848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23805): Terminated: ok {rc=0} 22:44:44.993941 bus /gobi_0: Setting Powered False 22:44:46.095035 bus /gobi_0: Setting Powered False 22:44:47.214368 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 22:44:48.465378 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:44:48.471231 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 22:44:48.500588 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 22:44:48.535207 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 22:44:48.587268 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 22:44:48.615842 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 22:44:48.650346 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 22:44:49.206860 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2350 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 22:44:49.212193 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:44:49.223380 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 22:44:49.288552 tst switch_tch_pdch.py: using LAC 17263 22:44:49.405833 tst switch_tch_pdch.py: using RAC 178 22:44:49.523605 tst switch_tch_pdch.py: using CellId 17263 22:44:49.645081 tst switch_tch_pdch.py: using BVCI 17264 22:44:49.755357 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:44:49.766716 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:44:49.777763 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:44:49.789065 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:44:49.800367 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:44:49.811906 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:44:49.823359 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:44:49.834709 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:44:49.949829 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:44:50.066261 tst switch_tch_pdch.py:51: start network... 22:44:50.264801 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:44:50.698671 run create_hlr_db(pid=23810): Launched 22:44:50.812085 bus /gobi_6: Setting Powered False 22:44:51.872045 run create_hlr_db(pid=23810): Terminated: ok {rc=0} 22:44:52.280758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23812): Launched 22:44:52.598229 run osmo-hlr_10.42.42.2(pid=23813): Launched 22:44:52.719229 run osmo-stp_10.42.42.5: Starting osmo-stp 22:44:53.238426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23815): Launched 22:44:53.554866 run osmo-stp_10.42.42.5(pid=23816): Launched 22:44:53.674955 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:44:54.195518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23818): Launched 22:44:54.316940 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:44:54.584803 run patchelf(pid=23819): Launched 22:44:54.762235 run osmo-stp_10.42.42.5(pid=23816): ERR: Terminated: ERROR {rc=1} [trial-2350↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23816)] 22:44:54.897362 run osmo-stp_10.42.42.5(pid=23816): stdout: | (launched: 2022-12-08_22:44:53.497465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:55.034095 run osmo-stp_10.42.42.5(pid=23816): stderr: | 20221208224453687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224453687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224453687 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224453688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224453690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224453690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224453690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:55.170421 run osmo-stp_10.42.42.5(pid=23816): stdout: | (launched: 2022-12-08_22:44:53.497465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:55.301205 run osmo-stp_10.42.42.5(pid=23816): stderr: | 20221208224453687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224453687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224453687 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224453688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224453690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224453690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224453690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:55.456575 run patchelf(pid=23819): Terminating (SIGINT) 22:44:55.635440 run patchelf(pid=23819): Terminated: ok {rc=0} 22:44:55.764492 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23816): Process ended prematurely: osmo-stp_10.42.42.5(pid=23816) [trial-2350↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23816)] [trial-2350↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 22:44:55.774058 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 22:44:55.802673 run osmo-hlr_10.42.42.2(pid=23813): ERR: Terminated: ERROR {rc=237} [trial-2350↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23813)] 22:44:55.853823 run osmo-hlr_10.42.42.2(pid=23813): stdout: | (launched: 2022-12-08_22:44:52.540336) 22:44:55.906731 run osmo-hlr_10.42.42.2(pid=23813): stderr: | 20221208224452740 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224452740 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224452740 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224452740 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224452740 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224452740 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224452755 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224452763 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224452764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224452764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:44:55.959684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23812): Terminating (SIGTERM) 22:44:56.002125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23815): Terminating (SIGTERM) 22:44:56.044707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23818): Terminating (SIGTERM) 22:44:56.087977 --- ParallelTerminationStrategy: PID 23812 died... 22:44:56.108238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23812): Terminated: ok {rc=0} 22:44:56.155320 --- ParallelTerminationStrategy: PID 23815 died... 22:44:56.175200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23815): Terminated: ok {rc=0} 22:44:56.222671 --- ParallelTerminationStrategy: PID 23818 died... 22:44:56.242593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23818): Terminated: ok {rc=0} 22:44:56.330853 bus /gobi_0: Setting Powered False 22:44:57.431714 bus /gobi_0: Setting Powered False 22:44:58.549162 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 nitb_sms:nanobts --------------------------------------------------------------------- 22:44:59.802498 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:44:59.806504 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 22:44:59.830832 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 22:44:59.837968 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 22:44:59.890623 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 22:44:59.915056 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 22:44:59.921932 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 22:45:00.458946 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 22:45:00.464380 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 22:45:00.475631 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 22:45:00.517725 tst mo_mt_sms.py: using LAC 17264 22:45:00.641175 tst mo_mt_sms.py: using RAC 179 22:45:00.763215 tst mo_mt_sms.py: using CellId 17264 22:45:00.890611 tst mo_mt_sms.py: using BVCI 17265 22:45:01.022038 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 22:45:01.140479 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 22:45:01.257371 tst mo_mt_sms.py:9: start nitb and bts... 22:45:01.510285 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:45:02.159556 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23828): Launched 22:45:02.465461 run osmo-nitb_10.42.42.2(pid=23829): Launched 22:45:02.631538 run osmo-nitb_10.42.42.2(pid=23829): ERR: Terminated: ERROR {rc=2} [trial-2350↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23829)] 22:45:02.767232 run osmo-nitb_10.42.42.2(pid=23829): stdout: | (launched: 2022-12-08_22:45:02.410455) 22:45:02.904174 run osmo-nitb_10.42.42.2(pid=23829): stderr: | (launched: 2022-12-08_22:45:02.455590) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:45:03.041193 run osmo-nitb_10.42.42.2(pid=23829): stdout: | (launched: 2022-12-08_22:45:02.410455) 22:45:03.172351 run osmo-nitb_10.42.42.2(pid=23829): stderr: | (launched: 2022-12-08_22:45:02.455590) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3c9519268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23829): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23829) [trial-2350↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23829)] 22:45:03.578804 tst osmo-nitb_10.42.42.2(pid=23829): stdout: | (launched: 2022-12-08_22:45:02.410455) 22:45:03.698935 tst osmo-nitb_10.42.42.2(pid=23829): stderr: | (launched: 2022-12-08_22:45:02.455590) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:45:03.841089 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=23829): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23829) [trial-2350↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23829)] [trial-2350↪nitb_sms:nanobts↪mo_mt_sms.py:11] 22:45:03.849685 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 22:45:03.856409 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23828): Terminating (SIGTERM) 22:45:04.066495 --- ParallelTerminationStrategy: PID 23828 died... 22:45:04.087889 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23828): Terminated: ok {rc=0} 22:45:04.174466 bus /sierra_3: Setting Powered False 22:45:05.273625 bus /sierra_3: Setting Powered False 22:45:06.389562 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 sms:nanobts+band-1900 --------------------------------------------------------------------- 22:45:07.574569 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:45:07.579850 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 22:45:07.603840 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 22:45:07.630928 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 22:45:07.682753 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 22:45:07.706733 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 22:45:07.733355 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 22:45:08.282492 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 22:45:08.287549 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:08.298778 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:45:08.336005 tst mo_mt_sms.py: using LAC 17265 22:45:08.460707 tst mo_mt_sms.py: using RAC 180 22:45:08.588686 tst mo_mt_sms.py: using CellId 17265 22:45:08.715204 tst mo_mt_sms.py: using BVCI 17266 22:45:08.832029 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:08.843057 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:08.854016 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:08.864928 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:08.875836 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:08.886745 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 22:45:09.000884 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 22:45:09.117043 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:45:09.577094 run create_hlr_db(pid=23834): Launched 22:45:09.691802 bus /sierra_2: Setting Powered False 22:45:10.750711 run create_hlr_db(pid=23834): Terminated: ok {rc=0} 22:45:11.163953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23836): Launched 22:45:11.460042 run osmo-hlr_10.42.42.2(pid=23837): Launched 22:45:11.572766 run osmo-stp_10.42.42.5: Starting osmo-stp 22:45:12.092506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23839): Launched 22:45:12.387698 run osmo-stp_10.42.42.5(pid=23840): Launched 22:45:12.500662 run osmo-msc_10.42.42.6: Starting osmo-msc 22:45:13.037211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23842): Launched 22:45:13.334010 run osmo-msc_10.42.42.6(pid=23843): Launched 22:45:13.500465 run osmo-stp_10.42.42.5(pid=23840): ERR: Terminated: ERROR {rc=1} [trial-2350↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23840)] 22:45:13.626965 run osmo-stp_10.42.42.5(pid=23840): stdout: | (launched: 2022-12-08_22:45:12.333734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:13.754006 run osmo-stp_10.42.42.5(pid=23840): stderr: | 20221208224512503 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224512504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224512504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224512504 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224512505 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224512505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224512505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:13.878632 run osmo-stp_10.42.42.5(pid=23840): stdout: | (launched: 2022-12-08_22:45:12.333734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:13.997335 run osmo-stp_10.42.42.5(pid=23840): stderr: | 20221208224512503 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224512504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224512504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224512504 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224512505 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224512505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224512505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:14.139062 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=23840): Process ended prematurely: osmo-stp_10.42.42.5(pid=23840) [trial-2350↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23840)] [trial-2350↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 22:45:14.147362 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 22:45:14.173849 run osmo-hlr_10.42.42.2(pid=23837): ERR: Terminated: ERROR {rc=237} [trial-2350↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23837)] 22:45:14.222629 run osmo-hlr_10.42.42.2(pid=23837): stdout: | (launched: 2022-12-08_22:45:11.405373) 22:45:14.273050 run osmo-hlr_10.42.42.2(pid=23837): stderr: | 20221208224511581 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224511581 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224511581 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224511581 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224511581 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224511581 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224511594 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224511602 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224511603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224511603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:45:14.343052 run osmo-msc_10.42.42.6(pid=23843): ERR: Terminated: ERROR {rc=2} [trial-2350↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23843)] 22:45:14.391478 run osmo-msc_10.42.42.6(pid=23843): stdout: | (launched: 2022-12-08_22:45:13.279509) 22:45:14.441744 run osmo-msc_10.42.42.6(pid=23843): stderr: | 20221208224513550 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208224513550 DLGLOBAL DEBUG validating counter group 0x7ff47ab47c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208224513550 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208224513550 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208224513550 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208224513550 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208224513553 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208224513553 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208224513553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208224513553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:45:14.492248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23836): Terminating (SIGTERM) 22:45:14.532611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23839): Terminating (SIGTERM) 22:45:14.573208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23842): Terminating (SIGTERM) 22:45:14.614042 --- ParallelTerminationStrategy: PID 23836 died... 22:45:14.633279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23836): Terminated: ok {rc=0} 22:45:14.678306 --- ParallelTerminationStrategy: PID 23839 died... 22:45:14.697112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23839): Terminated: ok {rc=0} 22:45:14.741975 --- ParallelTerminationStrategy: PID 23842 died... 22:45:14.760538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23842): Terminated: ok {rc=0} 22:45:14.845530 bus /sierra_3: Setting Powered False 22:45:15.948497 bus /sierra_3: Setting Powered False 22:45:17.070965 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 22:45:18.298105 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:45:18.303273 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 22:45:18.329585 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 22:45:18.337071 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 22:45:18.371716 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 22:45:18.395071 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 22:45:18.402028 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 22:45:18.921499 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2350 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 22:45:18.926621 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 22:45:18.937554 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:45:18.976769 tst assert_extension.py: using LAC 17266 22:45:19.094398 tst assert_extension.py: using RAC 181 22:45:19.213105 tst assert_extension.py: using CellId 17266 22:45:19.330831 tst assert_extension.py: using BVCI 17267 22:45:19.441123 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 22:45:19.556550 tst assert_extension.py:10: start nitb and bts... 22:45:19.770973 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:45:20.418240 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23848): Launched 22:45:20.735519 run osmo-nitb_10.42.42.2(pid=23849): Launched 22:45:20.912184 run osmo-nitb_10.42.42.2(pid=23849): ERR: Terminated: ERROR {rc=2} [trial-2350↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23849)] 22:45:21.055538 run osmo-nitb_10.42.42.2(pid=23849): stdout: | (launched: 2022-12-08_22:45:20.678104) 22:45:21.200720 run osmo-nitb_10.42.42.2(pid=23849): stderr: | (launched: 2022-12-08_22:45:20.725594) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:45:21.345538 run osmo-nitb_10.42.42.2(pid=23849): stdout: | (launched: 2022-12-08_22:45:20.678104) 22:45:21.484507 run osmo-nitb_10.42.42.2(pid=23849): stderr: | (launched: 2022-12-08_22:45:20.725594) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3c9519268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23849): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23849) [trial-2350↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23849)] 22:45:21.855904 tst osmo-nitb_10.42.42.2(pid=23849): stdout: | (launched: 2022-12-08_22:45:20.678104) 22:45:21.983911 tst osmo-nitb_10.42.42.2(pid=23849): stderr: | (launched: 2022-12-08_22:45:20.725594) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:45:22.134756 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=23849): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23849) [trial-2350↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23849)] [trial-2350↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 22:45:22.144258 tst assert_extension.py:12: Test FAILED (3.2 sec) 22:45:22.151694 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23848): Terminating (SIGTERM) 22:45:22.362889 --- ParallelTerminationStrategy: PID 23848 died... 22:45:22.384886 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23848): Terminated: ok {rc=0} 22:45:22.474092 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 ussd:nanobts+band-1900 --------------------------------------------------------------------- 22:45:23.638659 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:45:23.644837 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 22:45:23.669870 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 22:45:23.697149 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 22:45:23.734818 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 22:45:23.761748 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 22:45:23.788914 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 22:45:24.312244 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2350 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 22:45:24.318828 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:24.330516 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:45:24.368925 tst assert_extension.py: using LAC 17267 22:45:24.492805 tst assert_extension.py: using RAC 182 22:45:24.617153 tst assert_extension.py: using CellId 17267 22:45:24.740795 tst assert_extension.py: using BVCI 17268 22:45:24.856097 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:24.867108 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:24.878057 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:24.889087 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:24.900142 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:24.911282 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 22:45:25.027052 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:45:25.517733 run create_hlr_db(pid=23853): Launched 22:45:25.646857 bus /sierra_2: Setting Powered False 22:45:26.709734 run create_hlr_db(pid=23853): Terminated: ok {rc=0} 22:45:27.136229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23855): Launched 22:45:27.433421 run osmo-hlr_10.42.42.2(pid=23856): Launched 22:45:27.548209 run osmo-stp_10.42.42.5: Starting osmo-stp 22:45:28.067502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23858): Launched 22:45:28.364236 run osmo-stp_10.42.42.5(pid=23859): Launched 22:45:28.477910 run osmo-msc_10.42.42.6: Starting osmo-msc 22:45:29.015852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23861): Launched 22:45:29.312882 run osmo-msc_10.42.42.6(pid=23862): Launched 22:45:29.478510 run osmo-stp_10.42.42.5(pid=23859): ERR: Terminated: ERROR {rc=1} [trial-2350↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23859)] 22:45:29.606853 run osmo-stp_10.42.42.5(pid=23859): stdout: | (launched: 2022-12-08_22:45:28.309681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:29.733814 run osmo-stp_10.42.42.5(pid=23859): stderr: | 20221208224528477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224528477 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224528477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224528478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224528480 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224528480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224528480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:29.858697 run osmo-stp_10.42.42.5(pid=23859): stdout: | (launched: 2022-12-08_22:45:28.309681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:29.977649 run osmo-stp_10.42.42.5(pid=23859): stderr: | 20221208224528477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224528477 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224528477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224528478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224528480 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224528480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224528480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:30.119444 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=23859): Process ended prematurely: osmo-stp_10.42.42.5(pid=23859) [trial-2350↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23859)] [trial-2350↪ussd:nanobts+band-1900↪assert_extension.py:17] 22:45:30.127776 tst assert_extension.py:17: Test FAILED (5.8 sec) 22:45:30.154367 run osmo-hlr_10.42.42.2(pid=23856): ERR: Terminated: ERROR {rc=237} [trial-2350↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23856)] 22:45:30.203290 run osmo-hlr_10.42.42.2(pid=23856): stdout: | (launched: 2022-12-08_22:45:27.379259) 22:45:30.253786 run osmo-hlr_10.42.42.2(pid=23856): stderr: | 20221208224527555 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224527555 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224527555 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224527555 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224527555 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224527556 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224527566 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224527575 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224527575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224527575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:45:30.323761 run osmo-msc_10.42.42.6(pid=23862): ERR: Terminated: ERROR {rc=2} [trial-2350↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23862)] 22:45:30.372211 run osmo-msc_10.42.42.6(pid=23862): stdout: | (launched: 2022-12-08_22:45:29.258450) 22:45:30.422454 run osmo-msc_10.42.42.6(pid=23862): stderr: | 20221208224529527 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208224529527 DLGLOBAL DEBUG validating counter group 0x7f66277d3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208224529527 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208224529527 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208224529527 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208224529527 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208224529529 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208224529530 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208224529530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208224529530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:45:30.473339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23855): Terminating (SIGTERM) 22:45:30.513687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23858): Terminating (SIGTERM) 22:45:30.554835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23861): Terminating (SIGTERM) 22:45:30.595622 --- ParallelTerminationStrategy: PID 23855 died... 22:45:30.614856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23855): Terminated: ok {rc=0} 22:45:30.659795 --- ParallelTerminationStrategy: PID 23858 died... 22:45:30.678632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23858): Terminated: ok {rc=0} 22:45:30.723506 --- ParallelTerminationStrategy: PID 23861 died... 22:45:30.742249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23861): Terminated: ok {rc=0} 22:45:30.826637 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:45:32.032354 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:45:32.042051 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:45:32.074572 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:45:32.109085 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:45:32.165635 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:45:32.195495 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:45:32.223967 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:45:32.764806 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:45:32.814837 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:32.826204 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:45:32.884141 tst mo_mt_call.py: using LAC 17268 22:45:33.005276 tst mo_mt_call.py: using RAC 183 22:45:33.123880 tst mo_mt_call.py: using CellId 17268 22:45:33.245142 tst mo_mt_call.py: using BVCI 17269 22:45:33.354771 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:33.366051 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:33.377043 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:33.388188 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:33.399531 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:33.410908 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:45:33.528700 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:45:33.645201 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:45:34.112746 run create_hlr_db(pid=23867): Launched 22:45:34.227925 bus /sierra_2: Setting Powered False 22:45:35.287671 run create_hlr_db(pid=23867): Terminated: ok {rc=0} 22:45:35.709452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23869): Launched 22:45:36.012565 run osmo-hlr_10.42.42.2(pid=23870): Launched 22:45:36.127985 run osmo-stp_10.42.42.5: Starting osmo-stp 22:45:36.658673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23872): Launched 22:45:36.960084 run osmo-stp_10.42.42.5(pid=23873): Launched 22:45:37.075711 run osmo-msc_10.42.42.6: Starting osmo-msc 22:45:37.621523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23875): Launched 22:45:37.926398 run osmo-msc_10.42.42.6(pid=23876): Launched 22:45:38.095731 run osmo-stp_10.42.42.5(pid=23873): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23873)] 22:45:38.224921 run osmo-stp_10.42.42.5(pid=23873): stdout: | (launched: 2022-12-08_22:45:36.905359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:38.353620 run osmo-stp_10.42.42.5(pid=23873): stderr: | 20221208224537073 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224537073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224537073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224537074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224537076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224537076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224537076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:38.480105 run osmo-stp_10.42.42.5(pid=23873): stdout: | (launched: 2022-12-08_22:45:36.905359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:38.600901 run osmo-stp_10.42.42.5(pid=23873): stderr: | 20221208224537073 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224537073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224537073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224537074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224537076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224537076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224537076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:38.745624 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23873): Process ended prematurely: osmo-stp_10.42.42.5(pid=23873) [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23873)] [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:45:38.754430 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:45:38.781863 run osmo-hlr_10.42.42.2(pid=23870): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23870)] 22:45:38.830883 run osmo-hlr_10.42.42.2(pid=23870): stdout: | (launched: 2022-12-08_22:45:35.957188) 22:45:38.881322 run osmo-hlr_10.42.42.2(pid=23870): stderr: | 20221208224536133 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224536133 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224536133 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224536133 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224536133 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224536133 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224536146 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224536155 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224536155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224536155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:45:38.951534 run osmo-msc_10.42.42.6(pid=23876): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23876)] 22:45:39.000546 run osmo-msc_10.42.42.6(pid=23876): stdout: | (launched: 2022-12-08_22:45:37.870812) 22:45:39.050766 run osmo-msc_10.42.42.6(pid=23876): stderr: | 20221208224538143 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208224538143 DLGLOBAL DEBUG validating counter group 0x7f99618f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208224538143 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208224538143 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208224538143 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208224538143 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208224538145 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208224538146 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208224538146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208224538146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:45:39.101298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23869): Terminating (SIGTERM) 22:45:39.141408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23872): Terminating (SIGTERM) 22:45:39.181583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23875): Terminating (SIGTERM) 22:45:39.221952 --- ParallelTerminationStrategy: PID 23869 died... 22:45:39.241265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23869): Terminated: ok {rc=0} 22:45:39.286313 --- ParallelTerminationStrategy: PID 23872 died... 22:45:39.304901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23872): Terminated: ok {rc=0} 22:45:39.349879 --- ParallelTerminationStrategy: PID 23875 died... 22:45:39.368609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23875): Terminated: ok {rc=0} 22:45:39.455258 bus /sierra_3: Setting Powered False 22:45:40.555727 bus /sierra_3: Setting Powered False 22:45:41.672733 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:45:42.819511 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:42.831414 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:45:42.889818 tst mo_mt_call_osmux.py: using LAC 17269 22:45:43.009168 tst mo_mt_call_osmux.py: using RAC 184 22:45:43.127712 tst mo_mt_call_osmux.py: using CellId 17269 22:45:43.247776 tst mo_mt_call_osmux.py: using BVCI 17270 22:45:43.357955 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:43.368904 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:43.379866 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:43.391073 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:43.402301 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:43.413416 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:45:43.531568 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:45:43.649927 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:45:44.150265 run create_hlr_db(pid=23878): Launched 22:45:44.281354 bus /sierra_2: Setting Powered False 22:45:45.345687 run create_hlr_db(pid=23878): Terminated: ok {rc=0} 22:45:45.778584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23880): Launched 22:45:46.106022 run osmo-hlr_10.42.42.2(pid=23881): Launched 22:45:46.335261 run osmo-stp_10.42.42.5: Starting osmo-stp 22:45:47.035613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23883): Launched 22:45:47.425222 run osmo-stp_10.42.42.5(pid=23884): Launched 22:45:47.551442 run osmo-msc_10.42.42.6: Starting osmo-msc 22:45:48.138421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23886): Launched 22:45:48.462082 run osmo-msc_10.42.42.6(pid=23887): Launched 22:45:48.642834 run osmo-stp_10.42.42.5(pid=23884): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23884)] 22:45:48.780748 run osmo-stp_10.42.42.5(pid=23884): stdout: | (launched: 2022-12-08_22:45:47.366304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:48.917913 run osmo-stp_10.42.42.5(pid=23884): stderr: | 20221208224547556 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224547556 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224547557 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224547557 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224547559 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224547560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224547560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:49.054031 run osmo-stp_10.42.42.5(pid=23884): stdout: | (launched: 2022-12-08_22:45:47.366304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:49.183154 run osmo-stp_10.42.42.5(pid=23884): stderr: | 20221208224547556 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224547556 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224547557 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224547557 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224547559 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224547560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224547560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:49.337414 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23884): Process ended prematurely: osmo-stp_10.42.42.5(pid=23884) [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23884)] [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:45:49.347273 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 22:45:49.375350 run osmo-hlr_10.42.42.2(pid=23881): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23881)] 22:45:49.426139 run osmo-hlr_10.42.42.2(pid=23881): stdout: | (launched: 2022-12-08_22:45:46.043351) 22:45:49.478527 run osmo-hlr_10.42.42.2(pid=23881): stderr: | 20221208224546379 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224546379 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224546379 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224546379 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224546379 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224546379 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224546393 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224546401 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224546401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224546401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:45:49.551423 run osmo-msc_10.42.42.6(pid=23887): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23887)] 22:45:49.602081 run osmo-msc_10.42.42.6(pid=23887): stdout: | (launched: 2022-12-08_22:45:48.403529) 22:45:49.654373 run osmo-msc_10.42.42.6(pid=23887): stderr: | 20221208224548724 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208224548724 DLGLOBAL DEBUG validating counter group 0x7ff70bf85c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208224548724 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208224548724 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208224548724 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208224548725 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208224548726 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208224548727 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208224548727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208224548727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:45:49.707140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23880): Terminating (SIGTERM) 22:45:49.749725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23883): Terminating (SIGTERM) 22:45:49.792585 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23886): Terminating (SIGTERM) 22:45:49.835392 --- ParallelTerminationStrategy: PID 23880 died... 22:45:49.855783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23880): Terminated: ok {rc=0} 22:45:49.903040 --- ParallelTerminationStrategy: PID 23883 died... 22:45:49.922765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23883): Terminated: ok {rc=0} 22:45:49.969748 --- ParallelTerminationStrategy: PID 23886 died... 22:45:49.990005 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23886): Terminated: ok {rc=0} 22:45:50.079282 bus /sierra_3: Setting Powered False 22:45:51.179595 bus /sierra_3: Setting Powered False 22:45:52.296068 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:45:53.551724 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:45:53.560721 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:45:53.585201 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:45:53.611864 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:45:53.663604 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:45:53.687992 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:45:53.715015 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:45:54.264688 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:45:54.314220 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:45:54.325502 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:45:54.382535 tst mo_mt_call.py: using LAC 17270 22:45:54.500636 tst mo_mt_call.py: using RAC 185 22:45:54.618873 tst mo_mt_call.py: using CellId 17270 22:45:54.738788 tst mo_mt_call.py: using BVCI 17271 22:45:54.849326 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:45:54.860307 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:45:54.871317 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:45:54.882515 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:45:54.893861 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:45:54.905045 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:45:55.022556 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:45:55.142157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:45:55.642169 run create_hlr_db(pid=23892): Launched 22:45:55.773822 bus /sierra_2: Setting Powered False 22:45:56.837346 run create_hlr_db(pid=23892): Terminated: ok {rc=0} 22:45:57.270466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23894): Launched 22:45:57.572893 run osmo-hlr_10.42.42.2(pid=23895): Launched 22:45:57.687800 run osmo-stp_10.42.42.5: Starting osmo-stp 22:45:58.256783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23897): Launched 22:45:58.579615 run osmo-stp_10.42.42.5(pid=23898): Launched 22:45:58.703057 run osmo-msc_10.42.42.6: Starting osmo-msc 22:45:59.291150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23900): Launched 22:45:59.614399 run osmo-msc_10.42.42.6(pid=23901): Launched 22:45:59.794667 run osmo-stp_10.42.42.5(pid=23898): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23898)] 22:45:59.932255 run osmo-stp_10.42.42.5(pid=23898): stdout: | (launched: 2022-12-08_22:45:58.520941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:00.069493 run osmo-stp_10.42.42.5(pid=23898): stderr: | 20221208224558713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224558713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224558713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224558713 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224558714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224558714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224558714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:00.205776 run osmo-stp_10.42.42.5(pid=23898): stdout: | (launched: 2022-12-08_22:45:58.520941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:00.334773 run osmo-stp_10.42.42.5(pid=23898): stderr: | 20221208224558713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224558713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224558713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224558713 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224558714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224558714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224558714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:00.489326 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23898): Process ended prematurely: osmo-stp_10.42.42.5(pid=23898) [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23898)] [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:46:00.499056 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:46:00.527262 run osmo-hlr_10.42.42.2(pid=23895): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23895)] 22:46:00.577981 run osmo-hlr_10.42.42.2(pid=23895): stdout: | (launched: 2022-12-08_22:45:57.517670) 22:46:00.630198 run osmo-hlr_10.42.42.2(pid=23895): stderr: | 20221208224557694 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224557694 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224557694 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224557694 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224557695 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224557695 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224557707 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224557716 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224557716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224557716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:46:00.703191 run osmo-msc_10.42.42.6(pid=23901): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23901)] 22:46:00.754015 run osmo-msc_10.42.42.6(pid=23901): stdout: | (launched: 2022-12-08_22:45:59.555825) 22:46:00.806595 run osmo-msc_10.42.42.6(pid=23901): stderr: | 20221208224559875 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208224559876 DLGLOBAL DEBUG validating counter group 0x7fe9fdbe6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208224559876 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208224559876 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208224559876 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208224559876 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208224559878 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208224559878 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208224559878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208224559878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:46:00.867312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23894): Terminating (SIGTERM) 22:46:00.910463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23897): Terminating (SIGTERM) 22:46:00.955163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23900): Terminating (SIGTERM) 22:46:00.998720 --- ParallelTerminationStrategy: PID 23894 died... 22:46:01.019171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23894): Terminated: ok {rc=0} 22:46:01.066958 --- ParallelTerminationStrategy: PID 23897 died... 22:46:01.087310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23897): Terminated: ok {rc=0} 22:46:01.135227 --- ParallelTerminationStrategy: PID 23900 died... 22:46:01.155559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23900): Terminated: ok {rc=0} 22:46:01.245415 bus /sierra_3: Setting Powered False 22:46:02.346685 bus /sierra_3: Setting Powered False 22:46:03.460780 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:46:04.610336 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:46:04.622765 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:46:04.683577 tst mo_mt_call_osmux.py: using LAC 17271 22:46:04.805424 tst mo_mt_call_osmux.py: using RAC 186 22:46:04.927793 tst mo_mt_call_osmux.py: using CellId 17271 22:46:05.057728 tst mo_mt_call_osmux.py: using BVCI 17272 22:46:05.175405 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:46:05.187049 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:46:05.198531 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:46:05.210018 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:46:05.221602 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:46:05.233023 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:46:05.351015 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:46:05.467738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:46:05.939174 run create_hlr_db(pid=23903): Launched 22:46:06.055648 bus /sierra_2: Setting Powered False 22:46:07.116023 run create_hlr_db(pid=23903): Terminated: ok {rc=0} 22:46:07.558413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23905): Launched 22:46:07.883485 run osmo-hlr_10.42.42.2(pid=23906): Launched 22:46:08.006707 run osmo-stp_10.42.42.5: Starting osmo-stp 22:46:08.563161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23908): Launched 22:46:08.886605 run osmo-stp_10.42.42.5(pid=23909): Launched 22:46:09.009627 run osmo-msc_10.42.42.6: Starting osmo-msc 22:46:09.593699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23911): Launched 22:46:09.918845 run osmo-msc_10.42.42.6(pid=23912): Launched 22:46:10.099021 run osmo-stp_10.42.42.5(pid=23909): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23909)] 22:46:10.235907 run osmo-stp_10.42.42.5(pid=23909): stdout: | (launched: 2022-12-08_22:46:08.828216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:10.373222 run osmo-stp_10.42.42.5(pid=23909): stderr: | 20221208224609021 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224609021 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224609021 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224609022 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224609022 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224609022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224609022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:10.509412 run osmo-stp_10.42.42.5(pid=23909): stdout: | (launched: 2022-12-08_22:46:08.828216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:10.639420 run osmo-stp_10.42.42.5(pid=23909): stderr: | 20221208224609021 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224609021 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224609021 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224609022 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224609022 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224609022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224609022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:10.794143 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23909): Process ended prematurely: osmo-stp_10.42.42.5(pid=23909) [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23909)] [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:46:10.803958 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:46:10.832511 run osmo-hlr_10.42.42.2(pid=23906): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23906)] 22:46:10.883378 run osmo-hlr_10.42.42.2(pid=23906): stdout: | (launched: 2022-12-08_22:46:07.824411) 22:46:10.935801 run osmo-hlr_10.42.42.2(pid=23906): stderr: | 20221208224608021 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224608021 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224608021 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224608021 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224608021 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224608021 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224608034 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224608042 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224608042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224608043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:46:11.009381 run osmo-msc_10.42.42.6(pid=23912): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23912)] 22:46:11.060398 run osmo-msc_10.42.42.6(pid=23912): stdout: | (launched: 2022-12-08_22:46:09.859618) 22:46:11.112755 run osmo-msc_10.42.42.6(pid=23912): stderr: | 20221208224610181 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208224610181 DLGLOBAL DEBUG validating counter group 0x7f82ed516c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208224610181 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208224610182 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208224610182 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208224610182 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208224610183 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208224610184 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208224610184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208224610184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:46:11.165645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23905): Terminating (SIGTERM) 22:46:11.208129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23908): Terminating (SIGTERM) 22:46:11.250673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23911): Terminating (SIGTERM) 22:46:11.293373 --- ParallelTerminationStrategy: PID 23905 died... 22:46:11.313339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23905): Terminated: ok {rc=0} 22:46:11.360458 --- ParallelTerminationStrategy: PID 23908 died... 22:46:11.380385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23908): Terminated: ok {rc=0} 22:46:11.427364 --- ParallelTerminationStrategy: PID 23911 died... 22:46:11.447227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23911): Terminated: ok {rc=0} 22:46:11.535654 bus /sierra_3: Setting Powered False 22:46:12.635038 bus /sierra_3: Setting Powered False 22:46:13.752014 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:46:14.993635 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:46:15.001697 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:46:15.026206 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:46:15.054300 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:46:15.107498 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:46:15.131068 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:46:15.158109 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:46:15.708130 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:46:15.761877 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:15.774123 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:46:15.835495 tst mo_mt_call.py: using LAC 17272 22:46:15.979598 tst mo_mt_call.py: using RAC 187 22:46:16.107979 tst mo_mt_call.py: using CellId 17272 22:46:16.249983 tst mo_mt_call.py: using BVCI 17273 22:46:16.402780 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:16.417818 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:16.433925 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:16.449627 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:16.465518 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:16.481210 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:46:16.626495 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:46:16.767759 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:46:17.278421 run create_hlr_db(pid=23918): Launched 22:46:17.409398 bus /sierra_2: Setting Powered False 22:46:18.469847 run create_hlr_db(pid=23918): Terminated: ok {rc=0} 22:46:18.891808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23920): Launched 22:46:19.193911 run osmo-hlr_10.42.42.2(pid=23921): Launched 22:46:19.309078 run osmo-stp_10.42.42.5: Starting osmo-stp 22:46:19.842429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23923): Launched 22:46:20.144781 run osmo-stp_10.42.42.5(pid=23924): Launched 22:46:20.260846 run osmo-msc_10.42.42.6: Starting osmo-msc 22:46:20.807759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23926): Launched 22:46:21.110871 run osmo-msc_10.42.42.6(pid=23927): Launched 22:46:21.280323 run osmo-stp_10.42.42.5(pid=23924): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23924)] 22:46:21.409502 run osmo-stp_10.42.42.5(pid=23924): stdout: | (launched: 2022-12-08_22:46:20.089727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:21.538471 run osmo-stp_10.42.42.5(pid=23924): stderr: | 20221208224620258 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224620258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224620259 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224620259 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224620259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224620259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224620260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:21.665679 run osmo-stp_10.42.42.5(pid=23924): stdout: | (launched: 2022-12-08_22:46:20.089727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:21.788477 run osmo-stp_10.42.42.5(pid=23924): stderr: | 20221208224620258 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224620258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224620259 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224620259 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224620259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224620259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224620260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:21.933202 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23924): Process ended prematurely: osmo-stp_10.42.42.5(pid=23924) [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23924)] [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:46:21.942305 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:46:21.969351 run osmo-hlr_10.42.42.2(pid=23921): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23921)] 22:46:22.018637 run osmo-hlr_10.42.42.2(pid=23921): stdout: | (launched: 2022-12-08_22:46:19.138914) 22:46:22.069188 run osmo-hlr_10.42.42.2(pid=23921): stderr: | 20221208224619313 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224619313 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224619313 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224619313 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224619313 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224619313 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224619325 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224619333 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224619334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224619334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:46:22.139324 run osmo-msc_10.42.42.6(pid=23927): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23927)] 22:46:22.187643 run osmo-msc_10.42.42.6(pid=23927): stdout: | (launched: 2022-12-08_22:46:21.054781) 22:46:22.237688 run osmo-msc_10.42.42.6(pid=23927): stderr: | 20221208224621325 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208224621325 DLGLOBAL DEBUG validating counter group 0x7f5f9efb9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208224621325 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208224621325 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208224621325 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208224621326 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208224621327 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208224621328 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208224621328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208224621328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:46:22.288038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23920): Terminating (SIGTERM) 22:46:22.328242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23923): Terminating (SIGTERM) 22:46:22.368743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23926): Terminating (SIGTERM) 22:46:22.409235 --- ParallelTerminationStrategy: PID 23920 died... 22:46:22.428310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23920): Terminated: ok {rc=0} 22:46:22.473688 --- ParallelTerminationStrategy: PID 23923 died... 22:46:22.492629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23923): Terminated: ok {rc=0} 22:46:22.537654 --- ParallelTerminationStrategy: PID 23926 died... 22:46:22.556589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23926): Terminated: ok {rc=0} 22:46:22.643784 bus /sierra_3: Setting Powered False 22:46:23.744246 bus /sierra_3: Setting Powered False 22:46:24.861508 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:46:26.008205 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:26.020121 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:46:26.079671 tst mo_mt_call_osmux.py: using LAC 17273 22:46:26.204190 tst mo_mt_call_osmux.py: using RAC 188 22:46:26.330935 tst mo_mt_call_osmux.py: using CellId 17273 22:46:26.461506 tst mo_mt_call_osmux.py: using BVCI 17274 22:46:26.573870 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:26.584899 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:26.596002 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:26.607418 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:26.618711 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:26.630514 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:46:26.744626 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:46:26.865490 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:46:27.334070 run create_hlr_db(pid=23929): Launched 22:46:27.450232 bus /sierra_2: Setting Powered False 22:46:28.511407 run create_hlr_db(pid=23929): Terminated: ok {rc=0} 22:46:28.933047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23931): Launched 22:46:29.235188 run osmo-hlr_10.42.42.2(pid=23932): Launched 22:46:29.350794 run osmo-stp_10.42.42.5: Starting osmo-stp 22:46:29.886892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23934): Launched 22:46:30.189852 run osmo-stp_10.42.42.5(pid=23935): Launched 22:46:30.306189 run osmo-msc_10.42.42.6: Starting osmo-msc 22:46:30.872642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23937): Launched 22:46:31.259936 run osmo-msc_10.42.42.6(pid=23938): Launched 22:46:31.708846 run osmo-stp_10.42.42.5(pid=23935): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23935)] 22:46:31.871864 run osmo-stp_10.42.42.5(pid=23935): stdout: | (launched: 2022-12-08_22:46:30.134490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:32.038109 run osmo-stp_10.42.42.5(pid=23935): stderr: | 20221208224630305 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224630305 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224630305 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224630306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224630306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224630306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224630306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:32.208714 run osmo-stp_10.42.42.5(pid=23935): stdout: | (launched: 2022-12-08_22:46:30.134490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:32.360072 run osmo-stp_10.42.42.5(pid=23935): stderr: | 20221208224630305 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224630305 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224630305 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224630306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224630306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224630306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224630306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:32.516669 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23935): Process ended prematurely: osmo-stp_10.42.42.5(pid=23935) [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23935)] [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:46:32.526527 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 22:46:32.554970 run osmo-hlr_10.42.42.2(pid=23932): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23932)] 22:46:32.606249 run osmo-hlr_10.42.42.2(pid=23932): stdout: | (launched: 2022-12-08_22:46:29.180007) 22:46:32.658718 run osmo-hlr_10.42.42.2(pid=23932): stderr: | 20221208224629354 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224629354 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224629354 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224629354 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224629354 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224629354 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224629366 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224629374 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224629375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224629375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:46:32.731728 run osmo-msc_10.42.42.6(pid=23938): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23938)] 22:46:32.782823 run osmo-msc_10.42.42.6(pid=23938): stdout: | (launched: 2022-12-08_22:46:31.195436) 22:46:32.835724 run osmo-msc_10.42.42.6(pid=23938): stderr: | 20221208224631517 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208224631517 DLGLOBAL DEBUG validating counter group 0x7f74a6a2ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208224631517 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208224631517 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208224631517 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208224631518 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208224631519 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208224631520 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208224631520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208224631520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:46:32.888606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23931): Terminating (SIGTERM) 22:46:32.931218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23934): Terminating (SIGTERM) 22:46:32.973781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23937): Terminating (SIGTERM) 22:46:33.016556 --- ParallelTerminationStrategy: PID 23931 died... 22:46:33.036861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23931): Terminated: ok {rc=0} 22:46:33.083919 --- ParallelTerminationStrategy: PID 23934 died... 22:46:33.103650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23934): Terminated: ok {rc=0} 22:46:33.151141 --- ParallelTerminationStrategy: PID 23937 died... 22:46:33.170880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23937): Terminated: ok {rc=0} 22:46:33.259374 bus /sierra_3: Setting Powered False 22:46:34.358614 bus /sierra_3: Setting Powered False 22:46:35.474576 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:46:36.715335 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:46:36.723172 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:46:36.747433 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:46:36.775002 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:46:36.827595 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:46:36.851646 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:46:36.878577 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:46:37.432168 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:46:37.483470 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:37.495067 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:46:37.555309 tst mo_mt_call.py: using LAC 17274 22:46:37.683482 tst mo_mt_call.py: using RAC 189 22:46:37.810268 tst mo_mt_call.py: using CellId 17274 22:46:37.938327 tst mo_mt_call.py: using BVCI 17275 22:46:38.057293 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:38.068765 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:38.080155 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:38.091637 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:38.103113 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:38.114538 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:46:38.230534 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:46:38.346818 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:46:38.845183 run create_hlr_db(pid=23944): Launched 22:46:38.975974 bus /sierra_2: Setting Powered False 22:46:40.040609 run create_hlr_db(pid=23944): Terminated: ok {rc=0} 22:46:40.472051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23946): Launched 22:46:40.775773 run osmo-hlr_10.42.42.2(pid=23947): Launched 22:46:40.892133 run osmo-stp_10.42.42.5: Starting osmo-stp 22:46:41.416424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23949): Launched 22:46:41.719821 run osmo-stp_10.42.42.5(pid=23950): Launched 22:46:41.835308 run osmo-msc_10.42.42.6: Starting osmo-msc 22:46:42.383060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23952): Launched 22:46:42.685095 run osmo-msc_10.42.42.6(pid=23953): Launched 22:46:42.854773 run osmo-stp_10.42.42.5(pid=23950): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23950)] 22:46:42.984204 run osmo-stp_10.42.42.5(pid=23950): stdout: | (launched: 2022-12-08_22:46:41.664677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:43.113331 run osmo-stp_10.42.42.5(pid=23950): stderr: | 20221208224641835 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224641835 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224641835 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224641836 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224641836 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224641836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224641836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:43.240197 run osmo-stp_10.42.42.5(pid=23950): stdout: | (launched: 2022-12-08_22:46:41.664677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:43.360756 run osmo-stp_10.42.42.5(pid=23950): stderr: | 20221208224641835 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224641835 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224641835 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224641836 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224641836 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224641836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224641836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:43.505237 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23950): Process ended prematurely: osmo-stp_10.42.42.5(pid=23950) [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23950)] [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:46:43.514182 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:46:43.541434 run osmo-hlr_10.42.42.2(pid=23947): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23947)] 22:46:43.590331 run osmo-hlr_10.42.42.2(pid=23947): stdout: | (launched: 2022-12-08_22:46:40.720592) 22:46:43.640658 run osmo-hlr_10.42.42.2(pid=23947): stderr: | 20221208224640896 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224640897 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224640897 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224640897 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224640897 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224640897 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224640909 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224640917 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224640918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224640918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:46:43.710939 run osmo-msc_10.42.42.6(pid=23953): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23953)] 22:46:43.759364 run osmo-msc_10.42.42.6(pid=23953): stdout: | (launched: 2022-12-08_22:46:42.629512) 22:46:43.809540 run osmo-msc_10.42.42.6(pid=23953): stderr: | 20221208224642899 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208224642900 DLGLOBAL DEBUG validating counter group 0x7f27b422fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208224642900 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208224642900 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208224642900 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208224642900 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208224642902 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208224642902 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208224642902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208224642903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:46:43.860302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23946): Terminating (SIGTERM) 22:46:43.900375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23949): Terminating (SIGTERM) 22:46:43.940936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23952): Terminating (SIGTERM) 22:46:43.981713 --- ParallelTerminationStrategy: PID 23946 died... 22:46:44.000933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23946): Terminated: ok {rc=0} 22:46:44.046252 --- ParallelTerminationStrategy: PID 23949 died... 22:46:44.064884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23949): Terminated: ok {rc=0} 22:46:44.109989 --- ParallelTerminationStrategy: PID 23952 died... 22:46:44.128780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23952): Terminated: ok {rc=0} 22:46:44.216012 bus /sierra_3: Setting Powered False 22:46:45.315375 bus /sierra_3: Setting Powered False 22:46:46.438573 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:46:47.594170 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:47.606216 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:46:47.666284 tst mo_mt_call_osmux.py: using LAC 17275 22:46:47.786266 tst mo_mt_call_osmux.py: using RAC 190 22:46:47.905058 tst mo_mt_call_osmux.py: using CellId 17275 22:46:48.029937 tst mo_mt_call_osmux.py: using BVCI 17276 22:46:48.141761 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:48.152864 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:48.163982 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:48.175307 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:48.186753 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:48.198078 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:46:48.316411 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:46:48.433929 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:46:48.903067 run create_hlr_db(pid=23955): Launched 22:46:49.018162 bus /sierra_2: Setting Powered False 22:46:50.079267 run create_hlr_db(pid=23955): Terminated: ok {rc=0} 22:46:50.520219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23957): Launched 22:46:50.843768 run osmo-hlr_10.42.42.2(pid=23958): Launched 22:46:50.967494 run osmo-stp_10.42.42.5: Starting osmo-stp 22:46:51.527303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23960): Launched 22:46:51.851343 run osmo-stp_10.42.42.5(pid=23961): Launched 22:46:51.974721 run osmo-msc_10.42.42.6: Starting osmo-msc 22:46:52.560083 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23963): Launched 22:46:52.883947 run osmo-msc_10.42.42.6(pid=23964): Launched 22:46:53.064151 run osmo-stp_10.42.42.5(pid=23961): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23961)] 22:46:53.201508 run osmo-stp_10.42.42.5(pid=23961): stdout: | (launched: 2022-12-08_22:46:51.792179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:53.338566 run osmo-stp_10.42.42.5(pid=23961): stderr: | 20221208224651983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224651983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224651984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224651984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224651985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224651985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224651985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:53.474824 run osmo-stp_10.42.42.5(pid=23961): stdout: | (launched: 2022-12-08_22:46:51.792179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:53.604048 run osmo-stp_10.42.42.5(pid=23961): stderr: | 20221208224651983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224651983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224651984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224651984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224651985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224651985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224651985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:53.758506 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23961): Process ended prematurely: osmo-stp_10.42.42.5(pid=23961) [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23961)] [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:46:53.768218 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:46:53.796818 run osmo-hlr_10.42.42.2(pid=23958): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23958)] 22:46:53.847905 run osmo-hlr_10.42.42.2(pid=23958): stdout: | (launched: 2022-12-08_22:46:50.785148) 22:46:53.900542 run osmo-hlr_10.42.42.2(pid=23958): stderr: | 20221208224650982 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224650982 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224650982 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224650982 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224650982 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224650982 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224650995 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224651003 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224651003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224651003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:46:53.974826 run osmo-msc_10.42.42.6(pid=23964): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23964)] 22:46:54.025583 run osmo-msc_10.42.42.6(pid=23964): stdout: | (launched: 2022-12-08_22:46:52.825181) 22:46:54.078107 run osmo-msc_10.42.42.6(pid=23964): stderr: | 20221208224653148 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208224653148 DLGLOBAL DEBUG validating counter group 0x7fae8f8adc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208224653148 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208224653148 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208224653148 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208224653149 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208224653152 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208224653153 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208224653153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208224653153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:46:54.130732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23957): Terminating (SIGTERM) 22:46:54.172759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23960): Terminating (SIGTERM) 22:46:54.215068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23963): Terminating (SIGTERM) 22:46:54.257716 --- ParallelTerminationStrategy: PID 23957 died... 22:46:54.277695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23957): Terminated: ok {rc=0} 22:46:54.324650 --- ParallelTerminationStrategy: PID 23960 died... 22:46:54.344567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23960): Terminated: ok {rc=0} 22:46:54.391177 --- ParallelTerminationStrategy: PID 23963 died... 22:46:54.410935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23963): Terminated: ok {rc=0} 22:46:54.499280 bus /sierra_3: Setting Powered False 22:46:55.599197 bus /sierra_3: Setting Powered False 22:46:56.716652 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:46:57.958873 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:46:57.966894 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:46:57.991207 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:46:58.018564 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:46:58.071988 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:46:58.096503 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:46:58.123545 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:46:58.671184 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:46:58.720637 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:46:58.732003 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:46:58.791851 tst mo_mt_call.py: using LAC 17276 22:46:58.912388 tst mo_mt_call.py: using RAC 191 22:46:59.032131 tst mo_mt_call.py: using CellId 17276 22:46:59.150976 tst mo_mt_call.py: using BVCI 17277 22:46:59.262505 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:46:59.273692 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:46:59.284789 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:46:59.296090 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:46:59.307342 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:46:59.318517 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:46:59.435779 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:46:59.553930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:47:00.053939 run create_hlr_db(pid=23969): Launched 22:47:00.184713 bus /sierra_2: Setting Powered False 22:47:01.265417 run create_hlr_db(pid=23969): Terminated: ok {rc=0} 22:47:01.758884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23971): Launched 22:47:02.094656 run osmo-hlr_10.42.42.2(pid=23972): Launched 22:47:02.315826 run osmo-stp_10.42.42.5: Starting osmo-stp 22:47:02.837465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23974): Launched 22:47:03.142303 run osmo-stp_10.42.42.5(pid=23975): Launched 22:47:03.256833 run osmo-msc_10.42.42.6: Starting osmo-msc 22:47:03.805453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23977): Launched 22:47:04.109247 run osmo-msc_10.42.42.6(pid=23978): Launched 22:47:04.278085 run osmo-stp_10.42.42.5(pid=23975): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23975)] 22:47:04.407761 run osmo-stp_10.42.42.5(pid=23975): stdout: | (launched: 2022-12-08_22:47:03.085767) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:04.537426 run osmo-stp_10.42.42.5(pid=23975): stderr: | 20221208224703256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224703256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224703257 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224703257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224703258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224703258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224703258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:04.664338 run osmo-stp_10.42.42.5(pid=23975): stdout: | (launched: 2022-12-08_22:47:03.085767) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:04.785245 run osmo-stp_10.42.42.5(pid=23975): stderr: | 20221208224703256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224703256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224703257 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224703257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224703258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224703258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224703258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:04.929895 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23975): Process ended prematurely: osmo-stp_10.42.42.5(pid=23975) [trial-2350↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23975)] [trial-2350↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:47:04.938834 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:47:04.966275 run osmo-hlr_10.42.42.2(pid=23972): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23972)] 22:47:05.015662 run osmo-hlr_10.42.42.2(pid=23972): stdout: | (launched: 2022-12-08_22:47:02.033877) 22:47:05.066437 run osmo-hlr_10.42.42.2(pid=23972): stderr: | 20221208224702248 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224702248 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224702248 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224702248 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224702248 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224702248 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224702270 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224702282 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224702282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224702282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:47:05.137866 run osmo-msc_10.42.42.6(pid=23978): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23978)] 22:47:05.186935 run osmo-msc_10.42.42.6(pid=23978): stdout: | (launched: 2022-12-08_22:47:04.053967) 22:47:05.237506 run osmo-msc_10.42.42.6(pid=23978): stderr: | 20221208224704325 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208224704325 DLGLOBAL DEBUG validating counter group 0x7f7db4a71c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208224704325 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208224704326 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208224704326 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208224704326 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208224704328 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208224704329 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208224704329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208224704329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:47:05.288256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23971): Terminating (SIGTERM) 22:47:05.328930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23974): Terminating (SIGTERM) 22:47:05.369700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23977): Terminating (SIGTERM) 22:47:05.410622 --- ParallelTerminationStrategy: PID 23971 died... 22:47:05.429887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23971): Terminated: ok {rc=0} 22:47:05.475397 --- ParallelTerminationStrategy: PID 23974 died... 22:47:05.494399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23974): Terminated: ok {rc=0} 22:47:05.539345 --- ParallelTerminationStrategy: PID 23977 died... 22:47:05.558284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23977): Terminated: ok {rc=0} 22:47:05.643524 bus /sierra_3: Setting Powered False 22:47:06.742663 bus /sierra_3: Setting Powered False 22:47:07.860564 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:47:09.010353 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:47:09.022821 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:47:09.084381 tst mo_mt_call_osmux.py: using LAC 17277 22:47:09.211650 tst mo_mt_call_osmux.py: using RAC 192 22:47:09.340074 tst mo_mt_call_osmux.py: using CellId 17277 22:47:09.466833 tst mo_mt_call_osmux.py: using BVCI 17278 22:47:09.584015 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:47:09.595661 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:47:09.607123 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:47:09.618553 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:47:09.630202 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:47:09.641678 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:47:09.762171 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:47:09.880120 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:47:10.349248 run create_hlr_db(pid=23980): Launched 22:47:10.467133 bus /sierra_2: Setting Powered False 22:47:11.527851 run create_hlr_db(pid=23980): Terminated: ok {rc=0} 22:47:11.950155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23982): Launched 22:47:12.252750 run osmo-hlr_10.42.42.2(pid=23983): Launched 22:47:12.368689 run osmo-stp_10.42.42.5: Starting osmo-stp 22:47:12.908940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23985): Launched 22:47:13.212795 run osmo-stp_10.42.42.5(pid=23986): Launched 22:47:13.328235 run osmo-msc_10.42.42.6: Starting osmo-msc 22:47:13.877046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23988): Launched 22:47:14.181424 run osmo-msc_10.42.42.6(pid=23989): Launched 22:47:14.352892 run osmo-stp_10.42.42.5(pid=23986): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23986)] 22:47:14.484039 run osmo-stp_10.42.42.5(pid=23986): stdout: | (launched: 2022-12-08_22:47:13.157157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:14.613750 run osmo-stp_10.42.42.5(pid=23986): stderr: | 20221208224713326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224713326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224713326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224713327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224713327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224713327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224713327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:14.741851 run osmo-stp_10.42.42.5(pid=23986): stdout: | (launched: 2022-12-08_22:47:13.157157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:14.863796 run osmo-stp_10.42.42.5(pid=23986): stderr: | 20221208224713326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224713326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224713326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224713327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224713327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224713327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224713327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:15.009863 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23986): Process ended prematurely: osmo-stp_10.42.42.5(pid=23986) [trial-2350↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23986)] [trial-2350↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:47:15.018968 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 22:47:15.046649 run osmo-hlr_10.42.42.2(pid=23983): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23983)] 22:47:15.096099 run osmo-hlr_10.42.42.2(pid=23983): stdout: | (launched: 2022-12-08_22:47:12.197572) 22:47:15.146788 run osmo-hlr_10.42.42.2(pid=23983): stderr: | 20221208224712374 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224712374 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224712374 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224712374 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224712374 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224712374 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224712386 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224712395 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224712395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224712395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:47:15.217688 run osmo-msc_10.42.42.6(pid=23989): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23989)] 22:47:15.266870 run osmo-msc_10.42.42.6(pid=23989): stdout: | (launched: 2022-12-08_22:47:14.125982) 22:47:15.317411 run osmo-msc_10.42.42.6(pid=23989): stderr: | 20221208224714398 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208224714398 DLGLOBAL DEBUG validating counter group 0x7fc97d742c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208224714398 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208224714398 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208224714398 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208224714398 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208224714400 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208224714401 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208224714401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208224714401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:47:15.368662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23982): Terminating (SIGTERM) 22:47:15.409353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23985): Terminating (SIGTERM) 22:47:15.450586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23988): Terminating (SIGTERM) 22:47:15.491618 --- ParallelTerminationStrategy: PID 23982 died... 22:47:15.510935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23982): Terminated: ok {rc=0} 22:47:15.556186 --- ParallelTerminationStrategy: PID 23985 died... 22:47:15.575041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23985): Terminated: ok {rc=0} 22:47:15.620386 --- ParallelTerminationStrategy: PID 23988 died... 22:47:15.639494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23988): Terminated: ok {rc=0} 22:47:15.726797 bus /sierra_3: Setting Powered False 22:47:16.834650 bus /sierra_3: Setting Powered False 22:47:17.953358 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 emergency:nanobts+band-1900 --------------------------------------------------------------------- 22:47:19.194697 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:47:19.199897 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 22:47:19.223616 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 22:47:19.250511 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 22:47:19.333999 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 22:47:19.357585 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 22:47:19.384195 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 22:47:19.968796 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2350 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 22:47:19.974026 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:19.984779 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:47:20.023869 tst emergency_mo_mt_call.py: using LAC 17278 22:47:20.141372 tst emergency_mo_mt_call.py: using RAC 193 22:47:20.266572 tst emergency_mo_mt_call.py: using CellId 17278 22:47:20.392030 tst emergency_mo_mt_call.py: using BVCI 17279 22:47:20.507780 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:20.519168 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:20.530584 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:20.542157 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:20.553600 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:20.564660 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:47:20.677648 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:47:20.791249 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:47:21.251469 run create_hlr_db(pid=23994): Launched 22:47:21.365905 bus /sierra_2: Setting Powered False 22:47:22.426184 run create_hlr_db(pid=23994): Terminated: ok {rc=0} 22:47:22.861681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23996): Launched 22:47:23.179203 run osmo-hlr_10.42.42.2(pid=23997): Launched 22:47:23.300436 run osmo-stp_10.42.42.5: Starting osmo-stp 22:47:23.846762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23999): Launched 22:47:24.164058 run osmo-stp_10.42.42.5(pid=24000): Launched 22:47:24.294404 tst emergency_mo_mt_call.py: using MSISDN 6886 22:47:24.457472 run osmo-msc_10.42.42.6: Starting osmo-msc 22:47:25.029706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24002): Launched 22:47:25.348227 run osmo-msc_10.42.42.6(pid=24003): Launched 22:47:25.524281 run osmo-stp_10.42.42.5(pid=24000): ERR: Terminated: ERROR {rc=1} [trial-2350↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24000)] 22:47:25.658662 run osmo-stp_10.42.42.5(pid=24000): stdout: | (launched: 2022-12-08_22:47:24.105797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:25.793212 run osmo-stp_10.42.42.5(pid=24000): stderr: | 20221208224724298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224724298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224724298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224724299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224724299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224724299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224724299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:25.928188 run osmo-stp_10.42.42.5(pid=24000): stdout: | (launched: 2022-12-08_22:47:24.105797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:26.055052 run osmo-stp_10.42.42.5(pid=24000): stderr: | 20221208224724298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224724298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224724298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224724299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224724299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224724299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224724299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:26.207004 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=24000): Process ended prematurely: osmo-stp_10.42.42.5(pid=24000) [trial-2350↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24000)] [trial-2350↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 22:47:26.216229 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 22:47:26.244713 run osmo-hlr_10.42.42.2(pid=23997): ERR: Terminated: ERROR {rc=237} [trial-2350↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23997)] 22:47:26.295954 run osmo-hlr_10.42.42.2(pid=23997): stdout: | (launched: 2022-12-08_22:47:23.121341) 22:47:26.348802 run osmo-hlr_10.42.42.2(pid=23997): stderr: | 20221208224723317 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224723317 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224723317 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224723317 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224723317 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224723317 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224723329 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224723337 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224723337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224723337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:47:26.422694 run osmo-msc_10.42.42.6(pid=24003): ERR: Terminated: ERROR {rc=2} [trial-2350↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24003)] 22:47:26.473773 run osmo-msc_10.42.42.6(pid=24003): stdout: | (launched: 2022-12-08_22:47:25.289693) 22:47:26.527024 run osmo-msc_10.42.42.6(pid=24003): stderr: | 20221208224725611 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208224725611 DLGLOBAL DEBUG validating counter group 0x7fc0d1e86c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208224725611 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208224725611 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208224725611 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208224725612 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208224725613 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208224725614 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208224725614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208224725614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:47:26.580220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23996): Terminating (SIGTERM) 22:47:26.623369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23999): Terminating (SIGTERM) 22:47:26.666397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24002): Terminating (SIGTERM) 22:47:26.709546 --- ParallelTerminationStrategy: PID 23996 died... 22:47:26.729829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23996): Terminated: ok {rc=0} 22:47:26.777243 --- ParallelTerminationStrategy: PID 23999 died... 22:47:26.797100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23999): Terminated: ok {rc=0} 22:47:26.844671 --- ParallelTerminationStrategy: PID 24002 died... 22:47:26.864708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24002): Terminated: ok {rc=0} 22:47:26.952819 bus /sierra_3: Setting Powered False 22:47:28.052645 bus /sierra_3: Setting Powered False 22:47:29.170664 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 22:47:30.258250 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:30.269796 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:47:30.310697 tst emergency_preemptive_call.py: using LAC 17279 22:47:30.429409 tst emergency_preemptive_call.py: using RAC 194 22:47:30.544675 tst emergency_preemptive_call.py: using CellId 17279 22:47:30.664599 tst emergency_preemptive_call.py: using BVCI 17280 22:47:30.772407 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:30.783279 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:30.793949 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:30.804794 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:30.815557 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:30.826432 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:47:30.948780 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:47:31.065990 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:47:31.185335 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:47:31.331829 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:47:31.874452 run create_hlr_db(pid=24005): Launched 22:47:32.039027 bus /sierra_2: Setting Powered False 22:47:33.102200 run create_hlr_db(pid=24005): Terminated: ok {rc=0} 22:47:33.528919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24007): Launched 22:47:33.826965 run osmo-hlr_10.42.42.2(pid=24008): Launched 22:47:33.940619 run osmo-stp_10.42.42.5: Starting osmo-stp 22:47:34.465507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24010): Launched 22:47:34.765018 run osmo-stp_10.42.42.5(pid=24011): Launched 22:47:34.889432 tst emergency_preemptive_call.py: using MSISDN 6887 22:47:35.056452 run osmo-msc_10.42.42.6: Starting osmo-msc 22:47:35.593569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24013): Launched 22:47:35.907531 run osmo-msc_10.42.42.6(pid=24015): Launched 22:47:36.087200 run osmo-stp_10.42.42.5(pid=24011): ERR: Terminated: ERROR {rc=1} [trial-2350↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24011)] 22:47:36.224727 run osmo-stp_10.42.42.5(pid=24011): stdout: | (launched: 2022-12-08_22:47:34.710514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:36.362933 run osmo-stp_10.42.42.5(pid=24011): stderr: | 20221208224734880 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224734880 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224734880 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224734881 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224734881 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224734882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224734882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:36.498039 run osmo-stp_10.42.42.5(pid=24011): stdout: | (launched: 2022-12-08_22:47:34.710514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:36.626630 run osmo-stp_10.42.42.5(pid=24011): stderr: | 20221208224734880 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224734880 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224734880 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224734881 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224734881 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224734882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224734882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:36.778926 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=24011): Process ended prematurely: osmo-stp_10.42.42.5(pid=24011) [trial-2350↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24011)] [trial-2350↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 22:47:36.787769 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 22:47:36.815819 run osmo-hlr_10.42.42.2(pid=24008): ERR: Terminated: ERROR {rc=237} [trial-2350↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24008)] 22:47:36.867034 run osmo-hlr_10.42.42.2(pid=24008): stdout: | (launched: 2022-12-08_22:47:33.772575) 22:47:36.919981 run osmo-hlr_10.42.42.2(pid=24008): stderr: | 20221208224733944 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224733945 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224733945 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224733945 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224733945 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224733945 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224733956 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224733966 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224733967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224733967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:47:36.993704 run osmo-msc_10.42.42.6(pid=24015): ERR: Terminated: ERROR {rc=2} [trial-2350↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24015)] 22:47:37.044796 run osmo-msc_10.42.42.6(pid=24015): stdout: | (launched: 2022-12-08_22:47:35.849388) 22:47:37.097530 run osmo-msc_10.42.42.6(pid=24015): stderr: | 20221208224736165 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208224736165 DLGLOBAL DEBUG validating counter group 0x7fee2ba35c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208224736165 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208224736165 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208224736166 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208224736166 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208224736168 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208224736169 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208224736169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208224736169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:47:37.150794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24007): Terminating (SIGTERM) 22:47:37.193286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24010): Terminating (SIGTERM) 22:47:37.236018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24013): Terminating (SIGTERM) 22:47:37.278825 --- ParallelTerminationStrategy: PID 24007 died... 22:47:37.299121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24007): Terminated: ok {rc=0} 22:47:37.346277 --- ParallelTerminationStrategy: PID 24010 died... 22:47:37.366148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24010): Terminated: ok {rc=0} 22:47:37.413073 --- ParallelTerminationStrategy: PID 24013 died... 22:47:37.432752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24013): Terminated: ok {rc=0} 22:47:37.520752 bus /sierra_9: Setting Powered False 22:47:38.619993 bus /sierra_9: Setting Powered False 22:47:39.737803 bus /sierra_8: Setting Powered False 22:47:40.838716 bus /sierra_8: Setting Powered False 22:47:41.954919 bus /sierra_3: Setting Powered False 22:47:43.054477 bus /sierra_3: Setting Powered False 22:47:44.171701 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:nanobts+band-1900 --------------------------------------------------------------------- 22:47:45.449813 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:47:45.455413 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 22:47:45.478765 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 22:47:45.517704 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 22:47:45.603716 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 22:47:45.628919 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 22:47:45.669218 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 22:47:46.261212 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 22:47:46.314110 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:46.325790 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:47:46.366729 tst cs_paging_gprs_active.py: using LAC 17280 22:47:46.487945 tst cs_paging_gprs_active.py: using RAC 195 22:47:46.616810 tst cs_paging_gprs_active.py: using CellId 17280 22:47:46.746042 tst cs_paging_gprs_active.py: using BVCI 17281 22:47:46.860307 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:46.872114 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:46.884425 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:46.896917 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:46.908498 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:46.921168 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:46.934945 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:46.948876 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:46.963004 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:47:47.106560 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:47:47.226726 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:47:47.452180 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:47:47.777843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24020): Launched 22:47:48.061142 run iperf3-srv_10.42.42.10(pid=24021): Launched 22:47:48.183027 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:47:48.401592 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:47:48.727554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24022): Launched 22:47:49.009970 run iperf3-srv_10.42.42.10(pid=24023): Launched 22:47:49.131413 tst cs_paging_gprs_active.py:38: start network... 22:47:49.349843 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:47:49.852766 run create_hlr_db(pid=24024): Launched 22:47:49.984419 bus /sierra_2: Setting Powered False 22:47:51.048832 run create_hlr_db(pid=24024): Terminated: ok {rc=0} 22:47:51.480788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24026): Launched 22:47:51.784604 run osmo-hlr_10.42.42.2(pid=24027): Launched 22:47:51.900573 run osmo-stp_10.42.42.5: Starting osmo-stp 22:47:52.434768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24029): Launched 22:47:52.738637 run osmo-stp_10.42.42.5(pid=24030): Launched 22:47:52.854635 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:47:53.379939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24032): Launched 22:47:53.496931 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:47:53.754365 run patchelf(pid=24033): Launched 22:47:53.924107 run osmo-stp_10.42.42.5(pid=24030): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24030)] 22:47:54.053898 run osmo-stp_10.42.42.5(pid=24030): stdout: | (launched: 2022-12-08_22:47:52.682745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:54.185122 run osmo-stp_10.42.42.5(pid=24030): stderr: | 20221208224752854 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224752854 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224752855 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224752855 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224752855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224752856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224752856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:54.316612 run osmo-stp_10.42.42.5(pid=24030): stdout: | (launched: 2022-12-08_22:47:52.682745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:54.442822 run osmo-stp_10.42.42.5(pid=24030): stderr: | 20221208224752854 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224752854 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224752855 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224752855 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224752855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224752856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224752856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:54.591691 run patchelf(pid=24033): Terminating (SIGINT) 22:47:54.763608 run patchelf(pid=24033): Terminated: ok {rc=0} 22:47:54.887249 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24030): Process ended prematurely: osmo-stp_10.42.42.5(pid=24030) [trial-2350↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24030)] [trial-2350↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 22:47:54.896783 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 22:47:54.924593 run osmo-hlr_10.42.42.2(pid=24027): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24027)] 22:47:54.973281 run osmo-hlr_10.42.42.2(pid=24027): stdout: | (launched: 2022-12-08_22:47:51.729457) 22:47:55.023987 run osmo-hlr_10.42.42.2(pid=24027): stderr: | 20221208224751905 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224751905 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224751905 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224751905 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224751905 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224751905 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224751917 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224751925 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224751926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224751926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:47:55.075105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24020): Terminating (SIGTERM) 22:47:55.115890 run iperf3-srv_10.42.42.10(pid=24021): Terminating (SIGTERM) 22:47:55.156685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24022): Terminating (SIGTERM) 22:47:55.197536 run iperf3-srv_10.42.42.10(pid=24023): Terminating (SIGTERM) 22:47:55.238165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24026): Terminating (SIGTERM) 22:47:55.278907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24029): Terminating (SIGTERM) 22:47:55.319693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24032): Terminating (SIGTERM) 22:47:55.360770 --- ParallelTerminationStrategy: PID 24020 died... 22:47:55.380190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24020): Terminated: ok {rc=0} 22:47:55.425725 --- ParallelTerminationStrategy: PID 24021 died... 22:47:55.444552 run iperf3-srv_10.42.42.10(pid=24021): Terminated {rc=256} 22:47:55.489850 --- ParallelTerminationStrategy: PID 24022 died... 22:47:55.508757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24022): Terminated: ok {rc=0} 22:47:55.553922 --- ParallelTerminationStrategy: PID 24023 died... 22:47:55.572663 run iperf3-srv_10.42.42.10(pid=24023): Terminated {rc=256} 22:47:55.617630 --- ParallelTerminationStrategy: PID 24026 died... 22:47:55.636526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24026): Terminated: ok {rc=0} 22:47:55.681895 --- ParallelTerminationStrategy: PID 24029 died... 22:47:55.700644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24029): Terminated: ok {rc=0} 22:47:55.746171 --- ParallelTerminationStrategy: PID 24032 died... 22:47:55.765186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24032): Terminated: ok {rc=0} 22:47:55.852664 bus /gobi_0: Setting Powered False 22:47:56.952329 bus /gobi_0: Setting Powered False 22:47:58.071188 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 22:47:59.222007 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:59.233875 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:47:59.273978 tst iperf3.py: using LAC 17281 22:47:59.402485 tst iperf3.py: using RAC 196 22:47:59.529442 tst iperf3.py: using CellId 17281 22:47:59.658734 tst iperf3.py: using BVCI 17282 22:47:59.777987 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:59.789221 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:59.800206 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:59.811174 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:59.822123 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:59.833378 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:59.844552 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:59.855611 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:59.866759 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:47:59.986945 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:48:00.204247 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:00.528502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24034): Launched 22:48:00.809930 run iperf3-srv_10.42.42.10(pid=24035): Launched 22:48:00.954774 tst iperf3.py:8: start network... 22:48:01.175442 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:48:01.664292 run create_hlr_db(pid=24036): Launched 22:48:01.823426 bus /gobi_6: Setting Powered False 22:48:02.882939 run create_hlr_db(pid=24036): Terminated: ok {rc=0} 22:48:03.306196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24038): Launched 22:48:03.609891 run osmo-hlr_10.42.42.2(pid=24039): Launched 22:48:03.725054 run osmo-stp_10.42.42.5: Starting osmo-stp 22:48:04.259633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24041): Launched 22:48:04.562376 run osmo-stp_10.42.42.5(pid=24042): Launched 22:48:04.676937 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:48:05.201549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24044): Launched 22:48:05.318413 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:48:05.576598 run patchelf(pid=24045): Launched 22:48:05.746008 run osmo-stp_10.42.42.5(pid=24042): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24042)] 22:48:05.875256 run osmo-stp_10.42.42.5(pid=24042): stdout: | (launched: 2022-12-08_22:48:04.506842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:06.005667 run osmo-stp_10.42.42.5(pid=24042): stderr: | 20221208224804676 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224804676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224804676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224804677 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224804679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224804679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224804679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:06.136147 run osmo-stp_10.42.42.5(pid=24042): stdout: | (launched: 2022-12-08_22:48:04.506842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:06.261776 run osmo-stp_10.42.42.5(pid=24042): stderr: | 20221208224804676 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224804676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224804676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224804677 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224804679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224804679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224804679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:06.409968 run patchelf(pid=24045): Terminating (SIGINT) 22:48:06.580810 run patchelf(pid=24045): Terminated: ok {rc=0} 22:48:06.704144 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24042): Process ended prematurely: osmo-stp_10.42.42.5(pid=24042) [trial-2350↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24042)] [trial-2350↪gprs:nanobts+band-1900↪iperf3.py:8] 22:48:06.713768 tst iperf3.py:8: Test FAILED (7.5 sec) 22:48:06.741690 run osmo-hlr_10.42.42.2(pid=24039): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24039)] 22:48:06.790597 run osmo-hlr_10.42.42.2(pid=24039): stdout: | (launched: 2022-12-08_22:48:03.554119) 22:48:06.841446 run osmo-hlr_10.42.42.2(pid=24039): stderr: | 20221208224803728 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224803729 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224803729 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224803729 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224803729 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224803729 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224803740 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224803752 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224803752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224803752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:48:06.892623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24034): Terminating (SIGTERM) 22:48:06.933908 run iperf3-srv_10.42.42.10(pid=24035): Terminating (SIGTERM) 22:48:06.974635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24038): Terminating (SIGTERM) 22:48:07.015203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24041): Terminating (SIGTERM) 22:48:07.055679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24044): Terminating (SIGTERM) 22:48:07.096266 --- ParallelTerminationStrategy: PID 24034 died... 22:48:07.115655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24034): Terminated: ok {rc=0} 22:48:07.161090 --- ParallelTerminationStrategy: PID 24035 died... 22:48:07.179935 run iperf3-srv_10.42.42.10(pid=24035): Terminated {rc=256} 22:48:07.225422 --- ParallelTerminationStrategy: PID 24038 died... 22:48:07.244294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24038): Terminated: ok {rc=0} 22:48:07.289298 --- ParallelTerminationStrategy: PID 24041 died... 22:48:07.308210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24041): Terminated: ok {rc=0} 22:48:07.353396 --- ParallelTerminationStrategy: PID 24044 died... 22:48:07.372221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24044): Terminated: ok {rc=0} 22:48:07.456707 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 22:48:08.607763 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:08.619687 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:48:08.661712 tst iperf3m4.py: using LAC 17282 22:48:08.790924 tst iperf3m4.py: using RAC 197 22:48:08.921066 tst iperf3m4.py: using CellId 17282 22:48:09.048684 tst iperf3m4.py: using BVCI 17283 22:48:09.166806 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:09.177966 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:09.188930 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:09.200416 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:09.211976 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:09.223312 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:09.234970 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:09.246445 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:09.258180 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:48:09.374680 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:48:09.494926 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:48:09.608913 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:48:09.724591 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:48:09.928383 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:10.234624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24046): Launched 22:48:10.499101 run iperf3-srv_10.42.42.10(pid=24047): Launched 22:48:10.613731 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:48:10.816432 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:11.122771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24048): Launched 22:48:11.387464 run iperf3-srv_10.42.42.10(pid=24049): Launched 22:48:11.501970 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:48:11.705392 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:12.011204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24050): Launched 22:48:12.276294 run iperf3-srv_10.42.42.10(pid=24051): Launched 22:48:12.390652 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:48:12.593528 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:12.899777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24052): Launched 22:48:13.163790 run iperf3-srv_10.42.42.10(pid=24053): Launched 22:48:13.277384 tst iperf3m4.py:8: start network... 22:48:13.479508 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:48:13.949253 run create_hlr_db(pid=24054): Launched 22:48:14.065664 bus /gobi_6: Setting Powered False 22:48:15.126622 run create_hlr_db(pid=24054): Terminated: ok {rc=0} 22:48:15.549691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24056): Launched 22:48:15.869844 run osmo-hlr_10.42.42.2(pid=24057): Launched 22:48:16.058359 run osmo-stp_10.42.42.5: Starting osmo-stp 22:48:16.788510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24059): Launched 22:48:17.109949 run osmo-stp_10.42.42.5(pid=24060): Launched 22:48:17.348149 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:48:17.909072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24062): Launched 22:48:18.032603 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:48:18.306531 run patchelf(pid=24063): Launched 22:48:18.489268 run osmo-stp_10.42.42.5(pid=24060): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24060)] 22:48:18.627174 run osmo-stp_10.42.42.5(pid=24060): stdout: | (launched: 2022-12-08_22:48:17.051894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:18.766651 run osmo-stp_10.42.42.5(pid=24060): stderr: | 20221208224817267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224817267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224817267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224817267 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224817268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224817268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224817268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:18.906886 run osmo-stp_10.42.42.5(pid=24060): stdout: | (launched: 2022-12-08_22:48:17.051894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:19.041528 run osmo-stp_10.42.42.5(pid=24060): stderr: | 20221208224817267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224817267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224817267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224817267 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224817268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224817268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224817268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:19.200302 run patchelf(pid=24063): Terminating (SIGINT) 22:48:19.383046 run patchelf(pid=24063): Terminated: ok {rc=0} 22:48:19.515641 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24060): Process ended prematurely: osmo-stp_10.42.42.5(pid=24060) [trial-2350↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24060)] [trial-2350↪gprs:nanobts+band-1900↪iperf3m4.py:8] 22:48:19.525904 tst iperf3m4.py:8: Test FAILED (11.0 sec) 22:48:19.555461 run osmo-hlr_10.42.42.2(pid=24057): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24057)] 22:48:19.606253 run osmo-hlr_10.42.42.2(pid=24057): stdout: | (launched: 2022-12-08_22:48:15.798963) 22:48:19.658575 run osmo-hlr_10.42.42.2(pid=24057): stderr: | 20221208224816105 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224816105 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224816105 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224816105 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224816105 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224816105 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224816119 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224816136 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224816136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224816136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:48:19.711414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24046): Terminating (SIGTERM) 22:48:19.753711 run iperf3-srv_10.42.42.10(pid=24047): Terminating (SIGTERM) 22:48:19.796127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24048): Terminating (SIGTERM) 22:48:19.838508 run iperf3-srv_10.42.42.10(pid=24049): Terminating (SIGTERM) 22:48:19.881190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24050): Terminating (SIGTERM) 22:48:19.923749 run iperf3-srv_10.42.42.10(pid=24051): Terminating (SIGTERM) 22:48:19.966105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24052): Terminating (SIGTERM) 22:48:20.008381 run iperf3-srv_10.42.42.10(pid=24053): Terminating (SIGTERM) 22:48:20.050780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24056): Terminating (SIGTERM) 22:48:20.093163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24059): Terminating (SIGTERM) 22:48:20.135405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24062): Terminating (SIGTERM) 22:48:20.178096 --- ParallelTerminationStrategy: PID 24046 died... 22:48:20.198459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24046): Terminated: ok {rc=0} 22:48:20.245862 --- ParallelTerminationStrategy: PID 24047 died... 22:48:20.265634 run iperf3-srv_10.42.42.10(pid=24047): Terminated {rc=256} 22:48:20.312567 --- ParallelTerminationStrategy: PID 24048 died... 22:48:20.332510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24048): Terminated: ok {rc=0} 22:48:20.379566 --- ParallelTerminationStrategy: PID 24049 died... 22:48:20.399364 run iperf3-srv_10.42.42.10(pid=24049): Terminated {rc=256} 22:48:20.446080 --- ParallelTerminationStrategy: PID 24050 died... 22:48:20.466083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24050): Terminated: ok {rc=0} 22:48:20.512764 --- ParallelTerminationStrategy: PID 24051 died... 22:48:20.532606 run iperf3-srv_10.42.42.10(pid=24051): Terminated {rc=256} 22:48:20.579348 --- ParallelTerminationStrategy: PID 24052 died... 22:48:20.599375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24052): Terminated: ok {rc=0} 22:48:20.646005 --- ParallelTerminationStrategy: PID 24053 died... 22:48:20.666044 run iperf3-srv_10.42.42.10(pid=24053): Terminated {rc=256} 22:48:20.712610 --- ParallelTerminationStrategy: PID 24056 died... 22:48:20.732549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24056): Terminated: ok {rc=0} 22:48:20.779479 --- ParallelTerminationStrategy: PID 24059 died... 22:48:20.799469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24059): Terminated: ok {rc=0} 22:48:20.846692 --- ParallelTerminationStrategy: PID 24062 died... 22:48:20.866527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24062): Terminated: ok {rc=0} 22:48:20.955668 bus /gobi_4: Setting Powered False 22:48:22.057369 bus /gobi_4: Setting Powered False 22:48:23.174815 bus /gobi_1: Setting Powered False 22:48:24.274815 bus /gobi_1: Setting Powered False 22:48:25.395115 bus /gobi_0: Setting Powered False 22:48:26.495164 bus /gobi_0: Setting Powered False 22:48:27.610990 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 22:48:28.715494 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:28.727385 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:48:28.767201 tst ping.py: using LAC 17283 22:48:28.893130 tst ping.py: using RAC 198 22:48:29.022439 tst ping.py: using CellId 17283 22:48:29.148047 tst ping.py: using BVCI 17284 22:48:29.257641 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:29.268219 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:29.278838 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:29.289716 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:29.300309 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:29.311117 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:29.322029 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:29.332659 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:48:29.449599 tst ping.py:19: start network... 22:48:29.664422 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:48:30.157657 run create_hlr_db(pid=24064): Launched 22:48:30.276765 bus /gobi_6: Setting Powered False 22:48:31.335040 run create_hlr_db(pid=24064): Terminated: ok {rc=0} 22:48:31.767355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24066): Launched 22:48:32.084870 run osmo-hlr_10.42.42.2(pid=24067): Launched 22:48:32.258886 run osmo-stp_10.42.42.5: Starting osmo-stp 22:48:32.834151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24069): Launched 22:48:33.132362 run osmo-stp_10.42.42.5(pid=24070): Launched 22:48:33.245173 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:48:33.759677 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24072): Launched 22:48:33.874763 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:48:34.127540 run patchelf(pid=24073): Launched 22:48:34.293658 run osmo-stp_10.42.42.5(pid=24070): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24070)] 22:48:34.420914 run osmo-stp_10.42.42.5(pid=24070): stdout: | (launched: 2022-12-08_22:48:33.077848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:34.549731 run osmo-stp_10.42.42.5(pid=24070): stderr: | 20221208224833249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224833249 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224833249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224833250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224833250 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224833250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224833250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:34.678094 run osmo-stp_10.42.42.5(pid=24070): stdout: | (launched: 2022-12-08_22:48:33.077848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:34.800879 run osmo-stp_10.42.42.5(pid=24070): stderr: | 20221208224833249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224833249 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224833249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224833250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224833250 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224833250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224833250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:34.946448 run patchelf(pid=24073): Terminating (SIGINT) 22:48:35.115793 run patchelf(pid=24073): Terminated: ok {rc=0} 22:48:35.237397 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24070): Process ended prematurely: osmo-stp_10.42.42.5(pid=24070) [trial-2350↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24070)] [trial-2350↪gprs:nanobts+band-1900↪ping.py:22] 22:48:35.246335 tst ping.py:22: Test FAILED (6.5 sec) 22:48:35.273588 run osmo-hlr_10.42.42.2(pid=24067): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24067)] 22:48:35.322925 run osmo-hlr_10.42.42.2(pid=24067): stdout: | (launched: 2022-12-08_22:48:32.029566) 22:48:35.373412 run osmo-hlr_10.42.42.2(pid=24067): stderr: | 20221208224832393 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224832393 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224832393 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224832393 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224832393 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224832393 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224832415 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224832424 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224832424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224832424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:48:35.423937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24066): Terminating (SIGTERM) 22:48:35.464369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24069): Terminating (SIGTERM) 22:48:35.504991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24072): Terminating (SIGTERM) 22:48:35.545784 --- ParallelTerminationStrategy: PID 24066 died... 22:48:35.565274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24066): Terminated: ok {rc=0} 22:48:35.610649 --- ParallelTerminationStrategy: PID 24069 died... 22:48:35.629625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24069): Terminated: ok {rc=0} 22:48:35.674812 --- ParallelTerminationStrategy: PID 24072 died... 22:48:35.693682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24072): Terminated: ok {rc=0} 22:48:35.780480 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 22:48:36.868627 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:36.879986 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:48:36.920465 tst ping_idle_ping.py: using LAC 17284 22:48:37.047665 tst ping_idle_ping.py: using RAC 199 22:48:37.173057 tst ping_idle_ping.py: using CellId 17284 22:48:37.300363 tst ping_idle_ping.py: using BVCI 17285 22:48:37.415865 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:37.427173 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:37.438209 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:37.449284 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:37.460132 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:37.471597 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:37.482882 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:37.494136 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:48:37.609133 tst ping_idle_ping.py:24: start network... 22:48:37.809495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:48:38.273963 run create_hlr_db(pid=24074): Launched 22:48:38.388490 bus /gobi_6: Setting Powered False 22:48:39.452409 run create_hlr_db(pid=24074): Terminated: ok {rc=0} 22:48:39.898296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24076): Launched 22:48:40.218292 run osmo-hlr_10.42.42.2(pid=24077): Launched 22:48:40.339808 run osmo-stp_10.42.42.5: Starting osmo-stp 22:48:40.894443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24079): Launched 22:48:41.215087 run osmo-stp_10.42.42.5(pid=24080): Launched 22:48:41.336292 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:48:41.888276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24082): Launched 22:48:42.010381 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:48:42.280188 run patchelf(pid=24083): Launched 22:48:42.458867 run osmo-stp_10.42.42.5(pid=24080): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24080)] 22:48:42.595055 run osmo-stp_10.42.42.5(pid=24080): stdout: | (launched: 2022-12-08_22:48:41.156648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:42.732744 run osmo-stp_10.42.42.5(pid=24080): stderr: | 20221208224841351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224841351 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224841351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224841352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224841352 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224841352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224841352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:42.871017 run osmo-stp_10.42.42.5(pid=24080): stdout: | (launched: 2022-12-08_22:48:41.156648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:43.003145 run osmo-stp_10.42.42.5(pid=24080): stderr: | 20221208224841351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224841351 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224841351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224841352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224841352 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224841352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224841352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:43.159685 run patchelf(pid=24083): Terminating (SIGINT) 22:48:43.340019 run patchelf(pid=24083): Terminated: ok {rc=0} 22:48:43.469750 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24080): Process ended prematurely: osmo-stp_10.42.42.5(pid=24080) [trial-2350↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24080)] [trial-2350↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 22:48:43.479339 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:48:43.507820 run osmo-hlr_10.42.42.2(pid=24077): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24077)] 22:48:43.558581 run osmo-hlr_10.42.42.2(pid=24077): stdout: | (launched: 2022-12-08_22:48:40.160105) 22:48:43.611135 run osmo-hlr_10.42.42.2(pid=24077): stderr: | 20221208224840358 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224840358 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224840359 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224840359 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224840359 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224840359 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224840371 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224840381 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224840381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224840381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:48:43.664361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24076): Terminating (SIGTERM) 22:48:43.706834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24079): Terminating (SIGTERM) 22:48:43.749266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24082): Terminating (SIGTERM) 22:48:43.792196 --- ParallelTerminationStrategy: PID 24076 died... 22:48:43.812350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24076): Terminated: ok {rc=0} 22:48:43.860075 --- ParallelTerminationStrategy: PID 24079 died... 22:48:43.879913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24079): Terminated: ok {rc=0} 22:48:43.927180 --- ParallelTerminationStrategy: PID 24082 died... 22:48:43.947147 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24082): Terminated: ok {rc=0} 22:48:44.035152 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 22:48:45.334445 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:48:45.340900 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:48:45.365333 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:48:45.404369 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:48:45.494553 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:48:45.519012 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:48:45.557274 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:48:46.148411 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:48:46.217845 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:46.234012 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:48:46.284309 tst cs_paging_gprs_active.py: using LAC 17285 22:48:46.425160 tst cs_paging_gprs_active.py: using RAC 200 22:48:46.554907 tst cs_paging_gprs_active.py: using CellId 17285 22:48:46.684549 tst cs_paging_gprs_active.py: using BVCI 17286 22:48:46.833660 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:46.844671 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:46.855956 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:46.868829 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:46.882711 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:46.895535 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:46.907232 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:46.920037 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:46.934405 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:48:47.052513 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:48:47.184463 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:48:47.405329 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:47.730532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24087): Launched 22:48:48.012325 run iperf3-srv_10.42.42.10(pid=24088): Launched 22:48:48.134053 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:48:48.351974 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:48.676542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24089): Launched 22:48:48.957781 run iperf3-srv_10.42.42.10(pid=24090): Launched 22:48:49.078992 tst cs_paging_gprs_active.py:38: start network... 22:48:49.297912 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:48:49.800176 run create_hlr_db(pid=24091): Launched 22:48:49.931557 bus /gobi_6: Setting Powered False 22:48:50.996055 run create_hlr_db(pid=24091): Terminated: ok {rc=0} 22:48:51.429849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24093): Launched 22:48:51.734192 run osmo-hlr_10.42.42.2(pid=24094): Launched 22:48:51.850345 run osmo-stp_10.42.42.5: Starting osmo-stp 22:48:52.387985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24096): Launched 22:48:52.691564 run osmo-stp_10.42.42.5(pid=24097): Launched 22:48:52.807306 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:48:53.331760 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24099): Launched 22:48:53.449493 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:48:53.707124 run patchelf(pid=24100): Launched 22:48:53.877216 run osmo-stp_10.42.42.5(pid=24097): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24097)] 22:48:54.006977 run osmo-stp_10.42.42.5(pid=24097): stdout: | (launched: 2022-12-08_22:48:52.636195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:54.137996 run osmo-stp_10.42.42.5(pid=24097): stderr: | 20221208224852806 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224852806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224852806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224852806 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224852809 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224852809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224852809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:54.269220 run osmo-stp_10.42.42.5(pid=24097): stdout: | (launched: 2022-12-08_22:48:52.636195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:54.395282 run osmo-stp_10.42.42.5(pid=24097): stderr: | 20221208224852806 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224852806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224852806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224852806 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224852809 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224852809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224852809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:54.544351 run patchelf(pid=24100): Terminating (SIGINT) 22:48:54.715238 run patchelf(pid=24100): Terminated: ok {rc=0} 22:48:54.838922 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24097): Process ended prematurely: osmo-stp_10.42.42.5(pid=24097) [trial-2350↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24097)] [trial-2350↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:48:54.848402 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:48:54.876586 run osmo-hlr_10.42.42.2(pid=24094): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24094)] 22:48:54.925415 run osmo-hlr_10.42.42.2(pid=24094): stdout: | (launched: 2022-12-08_22:48:51.678880) 22:48:54.976329 run osmo-hlr_10.42.42.2(pid=24094): stderr: | 20221208224851854 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224851854 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224851854 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224851854 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224851854 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224851854 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224851867 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224851878 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224851878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224851878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:48:55.027497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24087): Terminating (SIGTERM) 22:48:55.068300 run iperf3-srv_10.42.42.10(pid=24088): Terminating (SIGTERM) 22:48:55.108998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24089): Terminating (SIGTERM) 22:48:55.149769 run iperf3-srv_10.42.42.10(pid=24090): Terminating (SIGTERM) 22:48:55.190472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24093): Terminating (SIGTERM) 22:48:55.231508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24096): Terminating (SIGTERM) 22:48:55.272387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24099): Terminating (SIGTERM) 22:48:55.313352 --- ParallelTerminationStrategy: PID 24087 died... 22:48:55.332528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24087): Terminated: ok {rc=0} 22:48:55.378447 --- ParallelTerminationStrategy: PID 24088 died... 22:48:55.397407 run iperf3-srv_10.42.42.10(pid=24088): Terminated {rc=256} 22:48:55.442291 --- ParallelTerminationStrategy: PID 24089 died... 22:48:55.461243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24089): Terminated: ok {rc=0} 22:48:55.506178 --- ParallelTerminationStrategy: PID 24090 died... 22:48:55.524926 run iperf3-srv_10.42.42.10(pid=24090): Terminated {rc=256} 22:48:55.569856 --- ParallelTerminationStrategy: PID 24093 died... 22:48:55.588661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24093): Terminated: ok {rc=0} 22:48:55.633670 --- ParallelTerminationStrategy: PID 24096 died... 22:48:55.652614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24096): Terminated: ok {rc=0} 22:48:55.697761 --- ParallelTerminationStrategy: PID 24099 died... 22:48:55.716746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24099): Terminated: ok {rc=0} 22:48:55.803631 bus /gobi_0: Setting Powered False 22:48:56.904378 bus /gobi_0: Setting Powered False 22:48:58.021913 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:48:59.171059 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:59.183134 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:48:59.227739 tst iperf3.py: using LAC 17286 22:48:59.358453 tst iperf3.py: using RAC 201 22:48:59.486433 tst iperf3.py: using CellId 17286 22:48:59.613434 tst iperf3.py: using BVCI 17287 22:48:59.733314 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:59.744582 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:59.756324 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:59.767947 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:59.779423 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:59.791246 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:59.803011 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:59.814608 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:59.826267 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:48:59.946378 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:49:00.164264 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:00.489280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24102): Launched 22:49:00.770532 run iperf3-srv_10.42.42.10(pid=24103): Launched 22:49:00.923206 tst iperf3.py:8: start network... 22:49:01.146110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:49:01.646224 run create_hlr_db(pid=24105): Launched 22:49:01.795643 bus /gobi_6: Setting Powered False 22:49:02.857648 run create_hlr_db(pid=24105): Terminated: ok {rc=0} 22:49:03.301764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24107): Launched 22:49:03.625894 run osmo-hlr_10.42.42.2(pid=24108): Launched 22:49:03.748334 run osmo-stp_10.42.42.5: Starting osmo-stp 22:49:04.312589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24110): Launched 22:49:04.637365 run osmo-stp_10.42.42.5(pid=24111): Launched 22:49:04.760075 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:49:05.320716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24113): Launched 22:49:05.444599 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:49:05.719081 run patchelf(pid=24114): Launched 22:49:05.899817 run osmo-stp_10.42.42.5(pid=24111): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24111)] 22:49:06.037605 run osmo-stp_10.42.42.5(pid=24111): stdout: | (launched: 2022-12-08_22:49:04.578290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:06.176756 run osmo-stp_10.42.42.5(pid=24111): stderr: | 20221208224904773 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224904773 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224904773 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224904774 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224904774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224904774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224904774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:06.316248 run osmo-stp_10.42.42.5(pid=24111): stdout: | (launched: 2022-12-08_22:49:04.578290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:06.450389 run osmo-stp_10.42.42.5(pid=24111): stderr: | 20221208224904773 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224904773 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224904773 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224904774 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224904774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224904774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224904774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:06.608508 run patchelf(pid=24114): Terminating (SIGINT) 22:49:06.790803 run patchelf(pid=24114): Terminated: ok {rc=0} 22:49:06.922279 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24111): Process ended prematurely: osmo-stp_10.42.42.5(pid=24111) [trial-2350↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24111)] [trial-2350↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 22:49:06.932339 tst iperf3.py:8: Test FAILED (7.8 sec) 22:49:06.961319 run osmo-hlr_10.42.42.2(pid=24108): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24108)] 22:49:07.012083 run osmo-hlr_10.42.42.2(pid=24108): stdout: | (launched: 2022-12-08_22:49:03.567214) 22:49:07.064332 run osmo-hlr_10.42.42.2(pid=24108): stderr: | 20221208224903765 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224903765 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224903765 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224903765 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224903765 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224903765 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224903777 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224903787 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224903787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224903787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:49:07.117362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24102): Terminating (SIGTERM) 22:49:07.159729 run iperf3-srv_10.42.42.10(pid=24103): Terminating (SIGTERM) 22:49:07.202238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24107): Terminating (SIGTERM) 22:49:07.244499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24110): Terminating (SIGTERM) 22:49:07.286640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24113): Terminating (SIGTERM) 22:49:07.329559 --- ParallelTerminationStrategy: PID 24102 died... 22:49:07.349780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24102): Terminated: ok {rc=0} 22:49:07.396624 --- ParallelTerminationStrategy: PID 24103 died... 22:49:07.416313 run iperf3-srv_10.42.42.10(pid=24103): Terminated {rc=256} 22:49:07.462813 --- ParallelTerminationStrategy: PID 24107 died... 22:49:07.482537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24107): Terminated: ok {rc=0} 22:49:07.529197 --- ParallelTerminationStrategy: PID 24110 died... 22:49:07.548821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24110): Terminated: ok {rc=0} 22:49:07.595466 --- ParallelTerminationStrategy: PID 24113 died... 22:49:07.615060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24113): Terminated: ok {rc=0} 22:49:07.703159 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:49:08.853625 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:08.865823 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:49:08.908049 tst iperf3m4.py: using LAC 17287 22:49:09.038346 tst iperf3m4.py: using RAC 202 22:49:09.167025 tst iperf3m4.py: using CellId 17287 22:49:09.294663 tst iperf3m4.py: using BVCI 17288 22:49:09.414900 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:09.426413 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:09.437552 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:09.448715 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:09.459870 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:09.470947 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:09.482293 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:09.493480 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:09.504719 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:49:09.620079 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:49:09.738184 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:49:09.857606 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:49:09.974540 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:49:10.179069 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:10.485244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24115): Launched 22:49:10.751670 run iperf3-srv_10.42.42.10(pid=24116): Launched 22:49:10.866512 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:49:11.070978 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:11.377679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24117): Launched 22:49:11.644124 run iperf3-srv_10.42.42.10(pid=24118): Launched 22:49:11.758907 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:49:11.963295 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:12.269952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24119): Launched 22:49:12.534943 run iperf3-srv_10.42.42.10(pid=24120): Launched 22:49:12.649579 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:49:12.853514 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:13.159311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24121): Launched 22:49:13.424504 run iperf3-srv_10.42.42.10(pid=24122): Launched 22:49:13.538907 tst iperf3m4.py:8: start network... 22:49:13.742736 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:49:14.215041 run create_hlr_db(pid=24123): Launched 22:49:14.332396 bus /gobi_6: Setting Powered False 22:49:15.397246 run create_hlr_db(pid=24123): Terminated: ok {rc=0} 22:49:15.853738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24125): Launched 22:49:16.212571 run osmo-hlr_10.42.42.2(pid=24126): Launched 22:49:16.440258 run osmo-stp_10.42.42.5: Starting osmo-stp 22:49:17.151313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24128): Launched 22:49:17.487823 run osmo-stp_10.42.42.5(pid=24129): Launched 22:49:17.614888 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:49:18.176301 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24131): Launched 22:49:18.300201 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:49:18.574770 run patchelf(pid=24132): Launched 22:49:18.755448 run osmo-stp_10.42.42.5(pid=24129): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24129)] 22:49:18.893406 run osmo-stp_10.42.42.5(pid=24129): stdout: | (launched: 2022-12-08_22:49:17.428041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:19.032547 run osmo-stp_10.42.42.5(pid=24129): stderr: | 20221208224917620 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224917620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224917620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224917621 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224917621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224917621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224917621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:19.171685 run osmo-stp_10.42.42.5(pid=24129): stdout: | (launched: 2022-12-08_22:49:17.428041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:19.305614 run osmo-stp_10.42.42.5(pid=24129): stderr: | 20221208224917620 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224917620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224917620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224917621 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224917621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224917621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224917621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:19.464733 run patchelf(pid=24132): Terminating (SIGINT) 22:49:19.647232 run patchelf(pid=24132): Terminated: ok {rc=0} 22:49:19.778497 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24129): Process ended prematurely: osmo-stp_10.42.42.5(pid=24129) [trial-2350↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24129)] [trial-2350↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 22:49:19.788713 tst iperf3m4.py:8: Test FAILED (11.0 sec) 22:49:19.818134 run osmo-hlr_10.42.42.2(pid=24126): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24126)] 22:49:19.869317 run osmo-hlr_10.42.42.2(pid=24126): stdout: | (launched: 2022-12-08_22:49:16.152264) 22:49:19.921911 run osmo-hlr_10.42.42.2(pid=24126): stderr: | 20221208224916422 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224916422 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224916422 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224916422 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224916422 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224916422 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224916439 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224916471 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224916471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224916471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:49:19.974921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24115): Terminating (SIGTERM) 22:49:20.017367 run iperf3-srv_10.42.42.10(pid=24116): Terminating (SIGTERM) 22:49:20.060430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24117): Terminating (SIGTERM) 22:49:20.102990 run iperf3-srv_10.42.42.10(pid=24118): Terminating (SIGTERM) 22:49:20.145479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24119): Terminating (SIGTERM) 22:49:20.187905 run iperf3-srv_10.42.42.10(pid=24120): Terminating (SIGTERM) 22:49:20.230186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24121): Terminating (SIGTERM) 22:49:20.272569 run iperf3-srv_10.42.42.10(pid=24122): Terminating (SIGTERM) 22:49:20.314662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24125): Terminating (SIGTERM) 22:49:20.357057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24128): Terminating (SIGTERM) 22:49:20.399138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24131): Terminating (SIGTERM) 22:49:20.441780 --- ParallelTerminationStrategy: PID 24115 died... 22:49:20.462159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24115): Terminated: ok {rc=0} 22:49:20.509367 --- ParallelTerminationStrategy: PID 24116 died... 22:49:20.529236 run iperf3-srv_10.42.42.10(pid=24116): Terminated {rc=256} 22:49:20.576072 --- ParallelTerminationStrategy: PID 24117 died... 22:49:20.596039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24117): Terminated: ok {rc=0} 22:49:20.642784 --- ParallelTerminationStrategy: PID 24118 died... 22:49:20.662680 run iperf3-srv_10.42.42.10(pid=24118): Terminated {rc=256} 22:49:20.709438 --- ParallelTerminationStrategy: PID 24119 died... 22:49:20.729322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24119): Terminated: ok {rc=0} 22:49:20.776153 --- ParallelTerminationStrategy: PID 24120 died... 22:49:20.796085 run iperf3-srv_10.42.42.10(pid=24120): Terminated {rc=256} 22:49:20.842715 --- ParallelTerminationStrategy: PID 24121 died... 22:49:20.862524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24121): Terminated: ok {rc=0} 22:49:20.909588 --- ParallelTerminationStrategy: PID 24122 died... 22:49:20.929524 run iperf3-srv_10.42.42.10(pid=24122): Terminated {rc=256} 22:49:20.976409 --- ParallelTerminationStrategy: PID 24125 died... 22:49:20.996061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24125): Terminated: ok {rc=0} 22:49:21.042815 --- ParallelTerminationStrategy: PID 24128 died... 22:49:21.062720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24128): Terminated: ok {rc=0} 22:49:21.109675 --- ParallelTerminationStrategy: PID 24131 died... 22:49:21.129450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24131): Terminated: ok {rc=0} 22:49:21.218050 bus /gobi_4: Setting Powered False 22:49:22.318773 bus /gobi_4: Setting Powered False 22:49:23.436438 bus /gobi_1: Setting Powered False 22:49:24.536633 bus /gobi_1: Setting Powered False 22:49:25.652216 bus /gobi_0: Setting Powered False 22:49:26.751298 bus /gobi_0: Setting Powered False 22:49:27.869792 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 22:49:28.973184 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:28.984702 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:49:29.028580 tst ping.py: using LAC 17288 22:49:29.146355 tst ping.py: using RAC 203 22:49:29.262005 tst ping.py: using CellId 17288 22:49:29.379869 tst ping.py: using BVCI 17289 22:49:29.496747 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:29.508372 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:29.519918 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:29.531469 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:29.542877 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:29.554577 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:29.566291 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:29.577777 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:49:29.695148 tst ping.py:19: start network... 22:49:29.895516 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:49:30.355441 run create_hlr_db(pid=24133): Launched 22:49:30.469730 bus /gobi_6: Setting Powered False 22:49:31.529275 run create_hlr_db(pid=24133): Terminated: ok {rc=0} 22:49:31.961766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24135): Launched 22:49:32.270510 run osmo-hlr_10.42.42.2(pid=24136): Launched 22:49:32.384551 run osmo-stp_10.42.42.5: Starting osmo-stp 22:49:32.914194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24138): Launched 22:49:33.211279 run osmo-stp_10.42.42.5(pid=24139): Launched 22:49:33.324496 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:49:33.839079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24141): Launched 22:49:33.953554 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:49:34.206441 run patchelf(pid=24142): Launched 22:49:34.372831 run osmo-stp_10.42.42.5(pid=24139): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24139)] 22:49:34.500068 run osmo-stp_10.42.42.5(pid=24139): stdout: | (launched: 2022-12-08_22:49:33.156883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:34.628886 run osmo-stp_10.42.42.5(pid=24139): stderr: | 20221208224933326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224933326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224933327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224933327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224933327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224933328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224933328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:34.757776 run osmo-stp_10.42.42.5(pid=24139): stdout: | (launched: 2022-12-08_22:49:33.156883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:34.881341 run osmo-stp_10.42.42.5(pid=24139): stderr: | 20221208224933326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224933326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224933327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224933327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224933327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224933328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224933328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:35.026829 run patchelf(pid=24142): Terminating (SIGINT) 22:49:35.195574 run patchelf(pid=24142): Terminated: ok {rc=0} 22:49:35.316940 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24139): Process ended prematurely: osmo-stp_10.42.42.5(pid=24139) [trial-2350↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24139)] [trial-2350↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 22:49:35.326131 tst ping.py:22: Test FAILED (6.3 sec) 22:49:35.353978 run osmo-hlr_10.42.42.2(pid=24136): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24136)] 22:49:35.403195 run osmo-hlr_10.42.42.2(pid=24136): stdout: | (launched: 2022-12-08_22:49:32.215930) 22:49:35.454023 run osmo-hlr_10.42.42.2(pid=24136): stderr: | 20221208224932393 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224932393 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224932393 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224932393 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224932393 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224932393 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224932405 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224932414 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224932414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224932414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:49:35.505494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24135): Terminating (SIGTERM) 22:49:35.546337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24138): Terminating (SIGTERM) 22:49:35.587101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24141): Terminating (SIGTERM) 22:49:35.628114 --- ParallelTerminationStrategy: PID 24135 died... 22:49:35.647317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24135): Terminated: ok {rc=0} 22:49:35.693173 --- ParallelTerminationStrategy: PID 24138 died... 22:49:35.712157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24138): Terminated: ok {rc=0} 22:49:35.757647 --- ParallelTerminationStrategy: PID 24141 died... 22:49:35.776625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24141): Terminated: ok {rc=0} 22:49:35.863919 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:49:36.952706 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:36.964674 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:49:37.009797 tst ping_idle_ping.py: using LAC 17289 22:49:37.128514 tst ping_idle_ping.py: using RAC 204 22:49:37.245264 tst ping_idle_ping.py: using CellId 17289 22:49:37.361569 tst ping_idle_ping.py: using BVCI 17290 22:49:37.472811 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:37.483900 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:37.494981 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:37.506187 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:37.517253 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:37.528284 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:37.539563 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:37.550790 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:49:37.665280 tst ping_idle_ping.py:24: start network... 22:49:37.865111 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:49:38.334706 run create_hlr_db(pid=24143): Launched 22:49:38.449494 bus /gobi_6: Setting Powered False 22:49:39.509934 run create_hlr_db(pid=24143): Terminated: ok {rc=0} 22:49:39.950663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24145): Launched 22:49:40.269999 run osmo-hlr_10.42.42.2(pid=24146): Launched 22:49:40.390927 run osmo-stp_10.42.42.5: Starting osmo-stp 22:49:40.922385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24148): Launched 22:49:41.221438 run osmo-stp_10.42.42.5(pid=24149): Launched 22:49:41.336535 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:49:41.858293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24151): Launched 22:49:41.973322 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:49:42.228173 run patchelf(pid=24152): Launched 22:49:42.396395 run osmo-stp_10.42.42.5(pid=24149): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24149)] 22:49:42.525220 run osmo-stp_10.42.42.5(pid=24149): stdout: | (launched: 2022-12-08_22:49:41.166954) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:42.654937 run osmo-stp_10.42.42.5(pid=24149): stderr: | 20221208224941334 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224941334 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224941334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224941335 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224941337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224941337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224941337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:42.784912 run osmo-stp_10.42.42.5(pid=24149): stdout: | (launched: 2022-12-08_22:49:41.166954) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:42.909438 run osmo-stp_10.42.42.5(pid=24149): stderr: | 20221208224941334 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224941334 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224941334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224941335 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224941337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224941337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224941337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:43.056244 run patchelf(pid=24152): Terminating (SIGINT) 22:49:43.226311 run patchelf(pid=24152): Terminated: ok {rc=0} 22:49:43.349154 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24149): Process ended prematurely: osmo-stp_10.42.42.5(pid=24149) [trial-2350↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24149)] [trial-2350↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 22:49:43.358218 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:49:43.385983 run osmo-hlr_10.42.42.2(pid=24146): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24146)] 22:49:43.435203 run osmo-hlr_10.42.42.2(pid=24146): stdout: | (launched: 2022-12-08_22:49:40.212155) 22:49:43.486194 run osmo-hlr_10.42.42.2(pid=24146): stderr: | 20221208224940410 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224940410 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224940410 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224940410 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224940410 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224940410 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224940422 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224940430 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224940430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224940431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:49:43.536996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24145): Terminating (SIGTERM) 22:49:43.578009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24148): Terminating (SIGTERM) 22:49:43.619040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24151): Terminating (SIGTERM) 22:49:43.660000 --- ParallelTerminationStrategy: PID 24145 died... 22:49:43.679244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24145): Terminated: ok {rc=0} 22:49:43.725015 --- ParallelTerminationStrategy: PID 24148 died... 22:49:43.744242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24148): Terminated: ok {rc=0} 22:49:43.789953 --- ParallelTerminationStrategy: PID 24151 died... 22:49:43.809034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24151): Terminated: ok {rc=0} 22:49:43.896224 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:49:45.190579 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:49:45.197768 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:49:45.222094 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:49:45.260127 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:49:45.347970 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:49:45.373652 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:49:45.414787 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:49:46.018792 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:49:46.079648 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:46.092148 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:49:46.155070 tst cs_paging_gprs_active.py: using LAC 17290 22:49:46.277054 tst cs_paging_gprs_active.py: using RAC 205 22:49:46.411951 tst cs_paging_gprs_active.py: using CellId 17290 22:49:46.532349 tst cs_paging_gprs_active.py: using BVCI 17291 22:49:46.659961 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:46.672993 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:46.686297 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:46.699535 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:46.711582 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:46.724676 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:46.738894 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:46.752017 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:46.764416 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:49:46.889122 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:49:47.038117 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:49:47.262969 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:47.592655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24156): Launched 22:49:47.876804 run iperf3-srv_10.42.42.10(pid=24157): Launched 22:49:47.999877 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:49:48.219830 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:48.547705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24158): Launched 22:49:48.830391 run iperf3-srv_10.42.42.10(pid=24159): Launched 22:49:48.953405 tst cs_paging_gprs_active.py:38: start network... 22:49:49.172512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:49:49.678270 run create_hlr_db(pid=24160): Launched 22:49:49.811563 bus /gobi_6: Setting Powered False 22:49:50.875510 run create_hlr_db(pid=24160): Terminated: ok {rc=0} 22:49:51.311190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24162): Launched 22:49:51.616397 run osmo-hlr_10.42.42.2(pid=24163): Launched 22:49:51.733445 run osmo-stp_10.42.42.5: Starting osmo-stp 22:49:52.257149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24165): Launched 22:49:52.561752 run osmo-stp_10.42.42.5(pid=24166): Launched 22:49:52.678182 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:49:53.203386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24168): Launched 22:49:53.320338 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:49:53.578728 run patchelf(pid=24169): Launched 22:49:53.749412 run osmo-stp_10.42.42.5(pid=24166): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24166)] 22:49:53.879068 run osmo-stp_10.42.42.5(pid=24166): stdout: | (launched: 2022-12-08_22:49:52.505924) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:54.010628 run osmo-stp_10.42.42.5(pid=24166): stderr: | 20221208224952676 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224952676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224952676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224952677 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224952677 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224952677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224952677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:54.142558 run osmo-stp_10.42.42.5(pid=24166): stdout: | (launched: 2022-12-08_22:49:52.505924) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:54.268778 run osmo-stp_10.42.42.5(pid=24166): stderr: | 20221208224952676 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208224952676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208224952676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208224952677 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208224952677 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208224952677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208224952677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:54.418217 run patchelf(pid=24169): Terminating (SIGINT) 22:49:54.590154 run patchelf(pid=24169): Terminated: ok {rc=0} 22:49:54.714227 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24166): Process ended prematurely: osmo-stp_10.42.42.5(pid=24166) [trial-2350↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24166)] [trial-2350↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:49:54.723635 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:49:54.752193 run osmo-hlr_10.42.42.2(pid=24163): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24163)] 22:49:54.801167 run osmo-hlr_10.42.42.2(pid=24163): stdout: | (launched: 2022-12-08_22:49:51.560519) 22:49:54.852126 run osmo-hlr_10.42.42.2(pid=24163): stderr: | 20221208224951738 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208224951738 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208224951738 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208224951738 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208224951738 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208224951738 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208224951751 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208224951759 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208224951759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208224951759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:49:54.903473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24156): Terminating (SIGTERM) 22:49:54.944504 run iperf3-srv_10.42.42.10(pid=24157): Terminating (SIGTERM) 22:49:54.985375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24158): Terminating (SIGTERM) 22:49:55.026147 run iperf3-srv_10.42.42.10(pid=24159): Terminating (SIGTERM) 22:49:55.067026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24162): Terminating (SIGTERM) 22:49:55.108274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24165): Terminating (SIGTERM) 22:49:55.149319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24168): Terminating (SIGTERM) 22:49:55.190466 --- ParallelTerminationStrategy: PID 24156 died... 22:49:55.209961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24156): Terminated: ok {rc=0} 22:49:55.255420 --- ParallelTerminationStrategy: PID 24157 died... 22:49:55.274436 run iperf3-srv_10.42.42.10(pid=24157): Terminated {rc=256} 22:49:55.319595 --- ParallelTerminationStrategy: PID 24158 died... 22:49:55.338549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24158): Terminated: ok {rc=0} 22:49:55.383713 --- ParallelTerminationStrategy: PID 24159 died... 22:49:55.402681 run iperf3-srv_10.42.42.10(pid=24159): Terminated {rc=256} 22:49:55.448004 --- ParallelTerminationStrategy: PID 24162 died... 22:49:55.466960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24162): Terminated: ok {rc=0} 22:49:55.512691 --- ParallelTerminationStrategy: PID 24165 died... 22:49:55.531825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24165): Terminated: ok {rc=0} 22:49:55.577144 --- ParallelTerminationStrategy: PID 24168 died... 22:49:55.596076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24168): Terminated: ok {rc=0} 22:49:55.683058 bus /gobi_0: Setting Powered False 22:49:56.784438 bus /gobi_0: Setting Powered False 22:49:57.903218 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:49:59.054309 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:59.066509 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:49:59.131170 tst iperf3.py: using LAC 17291 22:49:59.258609 tst iperf3.py: using RAC 206 22:49:59.387130 tst iperf3.py: using CellId 17291 22:49:59.513767 tst iperf3.py: using BVCI 17292 22:49:59.631818 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:59.643488 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:59.654964 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:59.666698 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:59.678353 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:59.689807 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:59.701537 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:59.713140 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:59.725362 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:49:59.846258 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:50:00.051064 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:50:00.354497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24170): Launched 22:50:00.618140 run iperf3-srv_10.42.42.10(pid=24171): Launched 22:50:00.731959 tst iperf3.py:8: start network... 22:50:00.950862 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:50:01.446611 run create_hlr_db(pid=24172): Launched 22:50:01.603366 bus /gobi_6: Setting Powered False 22:50:02.663964 run create_hlr_db(pid=24172): Terminated: ok {rc=0} 22:50:03.106160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24177): Launched 22:50:03.429970 run osmo-hlr_10.42.42.2(pid=24178): Launched 22:50:03.553044 run osmo-stp_10.42.42.5: Starting osmo-stp 22:50:04.113361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24180): Launched 22:50:04.438531 run osmo-stp_10.42.42.5(pid=24181): Launched 22:50:04.561698 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:50:05.121352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24183): Launched 22:50:05.245683 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:50:05.519842 run patchelf(pid=24184): Launched 22:50:05.700511 run osmo-stp_10.42.42.5(pid=24181): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24181)] 22:50:05.838985 run osmo-stp_10.42.42.5(pid=24181): stdout: | (launched: 2022-12-08_22:50:04.379732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:05.979047 run osmo-stp_10.42.42.5(pid=24181): stderr: | 20221208225004571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225004571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225004572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225004572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225004574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225004574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225004575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:06.118983 run osmo-stp_10.42.42.5(pid=24181): stdout: | (launched: 2022-12-08_22:50:04.379732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:06.252864 run osmo-stp_10.42.42.5(pid=24181): stderr: | 20221208225004571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225004571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225004572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225004572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225004574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225004574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225004575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:06.411662 run patchelf(pid=24184): Terminating (SIGINT) 22:50:06.594628 run patchelf(pid=24184): Terminated: ok {rc=0} 22:50:06.726254 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24181): Process ended prematurely: osmo-stp_10.42.42.5(pid=24181) [trial-2350↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24181)] [trial-2350↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 22:50:06.736727 tst iperf3.py:8: Test FAILED (7.7 sec) 22:50:06.765898 run osmo-hlr_10.42.42.2(pid=24178): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24178)] 22:50:06.817118 run osmo-hlr_10.42.42.2(pid=24178): stdout: | (launched: 2022-12-08_22:50:03.371361) 22:50:06.869750 run osmo-hlr_10.42.42.2(pid=24178): stderr: | 20221208225003571 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225003571 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225003571 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225003571 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225003571 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225003571 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225003583 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225003591 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225003592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225003592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:50:06.923483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24170): Terminating (SIGTERM) 22:50:06.966397 run iperf3-srv_10.42.42.10(pid=24171): Terminating (SIGTERM) 22:50:07.010679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24177): Terminating (SIGTERM) 22:50:07.055226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24180): Terminating (SIGTERM) 22:50:07.098147 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24183): Terminating (SIGTERM) 22:50:07.141171 --- ParallelTerminationStrategy: PID 24170 died... 22:50:07.161396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24170): Terminated: ok {rc=0} 22:50:07.209113 --- ParallelTerminationStrategy: PID 24171 died... 22:50:07.229144 run iperf3-srv_10.42.42.10(pid=24171): Terminated {rc=256} 22:50:07.276316 --- ParallelTerminationStrategy: PID 24177 died... 22:50:07.296419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24177): Terminated: ok {rc=0} 22:50:07.343697 --- ParallelTerminationStrategy: PID 24180 died... 22:50:07.364027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24180): Terminated: ok {rc=0} 22:50:07.411432 --- ParallelTerminationStrategy: PID 24183 died... 22:50:07.431449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24183): Terminated: ok {rc=0} 22:50:07.520586 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:50:08.668341 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:08.680088 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:50:08.740067 tst iperf3m4.py: using LAC 17292 22:50:08.861369 tst iperf3m4.py: using RAC 207 22:50:08.980272 tst iperf3m4.py: using CellId 17292 22:50:09.101384 tst iperf3m4.py: using BVCI 17293 22:50:09.213922 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:09.224834 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:09.235613 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:09.246598 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:09.257552 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:09.268559 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:09.279638 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:09.290780 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:09.302181 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:50:09.416538 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:50:09.533751 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:50:09.652794 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:50:09.767889 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:50:09.971867 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:50:10.276028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24185): Launched 22:50:10.540558 run iperf3-srv_10.42.42.10(pid=24186): Launched 22:50:10.655043 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:50:10.858229 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:50:11.163556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24187): Launched 22:50:11.427425 run iperf3-srv_10.42.42.10(pid=24188): Launched 22:50:11.541611 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:50:11.744693 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:50:12.049812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24189): Launched 22:50:12.315485 run iperf3-srv_10.42.42.10(pid=24190): Launched 22:50:12.429896 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:50:12.633220 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:50:12.938464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24191): Launched 22:50:13.202446 run iperf3-srv_10.42.42.10(pid=24192): Launched 22:50:13.316284 tst iperf3m4.py:8: start network... 22:50:13.519450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:50:13.990237 run create_hlr_db(pid=24193): Launched 22:50:14.105558 bus /gobi_6: Setting Powered False 22:50:15.166206 run create_hlr_db(pid=24193): Terminated: ok {rc=0} 22:50:15.590104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24195): Launched 22:50:15.901744 run osmo-hlr_10.42.42.2(pid=24196): Launched 22:50:16.125697 run osmo-stp_10.42.42.5: Starting osmo-stp 22:50:16.795557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24198): Launched 22:50:17.118292 run osmo-stp_10.42.42.5(pid=24199): Launched 22:50:17.317608 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:50:17.879190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24201): Launched 22:50:18.003782 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:50:18.278118 run patchelf(pid=24202): Launched 22:50:18.458893 run osmo-stp_10.42.42.5(pid=24199): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24199)] 22:50:18.596228 run osmo-stp_10.42.42.5(pid=24199): stdout: | (launched: 2022-12-08_22:50:17.059497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:18.735271 run osmo-stp_10.42.42.5(pid=24199): stderr: | 20221208225017324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225017324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225017324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225017325 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225017325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225017325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225017325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:18.874403 run osmo-stp_10.42.42.5(pid=24199): stdout: | (launched: 2022-12-08_22:50:17.059497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:19.008267 run osmo-stp_10.42.42.5(pid=24199): stderr: | 20221208225017324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225017324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225017324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225017325 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225017325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225017325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225017325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:19.166346 run patchelf(pid=24202): Terminating (SIGINT) 22:50:19.349116 run patchelf(pid=24202): Terminated: ok {rc=0} 22:50:19.480100 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24199): Process ended prematurely: osmo-stp_10.42.42.5(pid=24199) [trial-2350↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24199)] [trial-2350↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:50:19.490428 tst iperf3m4.py:8: Test FAILED (10.9 sec) 22:50:19.519602 run osmo-hlr_10.42.42.2(pid=24196): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24196)] 22:50:19.570381 run osmo-hlr_10.42.42.2(pid=24196): stdout: | (launched: 2022-12-08_22:50:15.838100) 22:50:19.622971 run osmo-hlr_10.42.42.2(pid=24196): stderr: | 20221208225016078 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225016078 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225016078 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225016078 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225016078 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225016078 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225016095 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225016109 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225016109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225016110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:50:19.675934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24185): Terminating (SIGTERM) 22:50:19.718719 run iperf3-srv_10.42.42.10(pid=24186): Terminating (SIGTERM) 22:50:19.762559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24187): Terminating (SIGTERM) 22:50:19.805382 run iperf3-srv_10.42.42.10(pid=24188): Terminating (SIGTERM) 22:50:19.847684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24189): Terminating (SIGTERM) 22:50:19.890252 run iperf3-srv_10.42.42.10(pid=24190): Terminating (SIGTERM) 22:50:19.933055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24191): Terminating (SIGTERM) 22:50:19.975547 run iperf3-srv_10.42.42.10(pid=24192): Terminating (SIGTERM) 22:50:20.017924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24195): Terminating (SIGTERM) 22:50:20.060472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24198): Terminating (SIGTERM) 22:50:20.103010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24201): Terminating (SIGTERM) 22:50:20.145761 --- ParallelTerminationStrategy: PID 24185 died... 22:50:20.166110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24185): Terminated: ok {rc=0} 22:50:20.213266 --- ParallelTerminationStrategy: PID 24186 died... 22:50:20.233102 run iperf3-srv_10.42.42.10(pid=24186): Terminated {rc=256} 22:50:20.279893 --- ParallelTerminationStrategy: PID 24187 died... 22:50:20.299828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24187): Terminated: ok {rc=0} 22:50:20.347081 --- ParallelTerminationStrategy: PID 24188 died... 22:50:20.367015 run iperf3-srv_10.42.42.10(pid=24188): Terminated {rc=256} 22:50:20.413650 --- ParallelTerminationStrategy: PID 24189 died... 22:50:20.433606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24189): Terminated: ok {rc=0} 22:50:20.480377 --- ParallelTerminationStrategy: PID 24190 died... 22:50:20.500240 run iperf3-srv_10.42.42.10(pid=24190): Terminated {rc=256} 22:50:20.546771 --- ParallelTerminationStrategy: PID 24191 died... 22:50:20.566675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24191): Terminated: ok {rc=0} 22:50:20.613369 --- ParallelTerminationStrategy: PID 24192 died... 22:50:20.633030 run iperf3-srv_10.42.42.10(pid=24192): Terminated {rc=256} 22:50:20.679499 --- ParallelTerminationStrategy: PID 24195 died... 22:50:20.699244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24195): Terminated: ok {rc=0} 22:50:20.745986 --- ParallelTerminationStrategy: PID 24198 died... 22:50:20.765817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24198): Terminated: ok {rc=0} 22:50:20.812548 --- ParallelTerminationStrategy: PID 24201 died... 22:50:20.832481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24201): Terminated: ok {rc=0} 22:50:20.921587 bus /gobi_4: Setting Powered False 22:50:22.022832 bus /gobi_4: Setting Powered False 22:50:23.142918 bus /gobi_1: Setting Powered False 22:50:24.242547 bus /gobi_1: Setting Powered False 22:50:25.359980 bus /gobi_0: Setting Powered False 22:50:26.459039 bus /gobi_0: Setting Powered False 22:50:27.577262 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:50:28.681504 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:28.693142 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:50:28.752902 tst ping.py: using LAC 17293 22:50:28.873265 tst ping.py: using RAC 208 22:50:29.003159 tst ping.py: using CellId 17293 22:50:29.128422 tst ping.py: using BVCI 17294 22:50:29.243876 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:29.255377 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:29.266710 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:29.277980 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:29.289226 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:29.300500 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:29.311872 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:29.323232 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:50:29.436188 tst ping.py:19: start network... 22:50:29.634743 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:50:30.094945 run create_hlr_db(pid=24203): Launched 22:50:30.209541 bus /gobi_6: Setting Powered False 22:50:31.271901 run create_hlr_db(pid=24203): Terminated: ok {rc=0} 22:50:31.728420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24205): Launched 22:50:32.051736 run osmo-hlr_10.42.42.2(pid=24206): Launched 22:50:32.243204 run osmo-stp_10.42.42.5: Starting osmo-stp 22:50:32.765381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24208): Launched 22:50:33.065365 run osmo-stp_10.42.42.5(pid=24209): Launched 22:50:33.179371 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:50:33.693485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24211): Launched 22:50:33.808672 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:50:34.062526 run patchelf(pid=24212): Launched 22:50:34.228351 run osmo-stp_10.42.42.5(pid=24209): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24209)] 22:50:34.355884 run osmo-stp_10.42.42.5(pid=24209): stdout: | (launched: 2022-12-08_22:50:33.010712) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:34.484435 run osmo-stp_10.42.42.5(pid=24209): stderr: | 20221208225033181 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225033181 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225033181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225033182 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225033182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225033182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225033182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:34.613226 run osmo-stp_10.42.42.5(pid=24209): stdout: | (launched: 2022-12-08_22:50:33.010712) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:34.735990 run osmo-stp_10.42.42.5(pid=24209): stderr: | 20221208225033181 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225033181 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225033181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225033182 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225033182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225033182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225033182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:34.881498 run patchelf(pid=24212): Terminating (SIGINT) 22:50:35.050023 run patchelf(pid=24212): Terminated: ok {rc=0} 22:50:35.171986 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24209): Process ended prematurely: osmo-stp_10.42.42.5(pid=24209) [trial-2350↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24209)] [trial-2350↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 22:50:35.181029 tst ping.py:22: Test FAILED (6.5 sec) 22:50:35.208870 run osmo-hlr_10.42.42.2(pid=24206): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24206)] 22:50:35.257519 run osmo-hlr_10.42.42.2(pid=24206): stdout: | (launched: 2022-12-08_22:50:31.991282) 22:50:35.307909 run osmo-hlr_10.42.42.2(pid=24206): stderr: | 20221208225032268 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225032268 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225032269 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225032269 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225032269 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225032269 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225032281 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225032289 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225032290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225032290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:50:35.358652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24205): Terminating (SIGTERM) 22:50:35.399174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24208): Terminating (SIGTERM) 22:50:35.439784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24211): Terminating (SIGTERM) 22:50:35.480825 --- ParallelTerminationStrategy: PID 24205 died... 22:50:35.500199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24205): Terminated: ok {rc=0} 22:50:35.545648 --- ParallelTerminationStrategy: PID 24208 died... 22:50:35.564519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24208): Terminated: ok {rc=0} 22:50:35.609884 --- ParallelTerminationStrategy: PID 24211 died... 22:50:35.628719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24211): Terminated: ok {rc=0} 22:50:35.715430 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:50:36.804651 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:36.816515 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:50:36.881396 tst ping_idle_ping.py: using LAC 17294 22:50:37.003170 tst ping_idle_ping.py: using RAC 209 22:50:37.124079 tst ping_idle_ping.py: using CellId 17294 22:50:37.241190 tst ping_idle_ping.py: using BVCI 17295 22:50:37.349643 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:37.360725 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:37.371634 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:37.382874 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:37.394043 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:37.405388 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:37.416670 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:37.427939 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:50:37.542436 tst ping_idle_ping.py:24: start network... 22:50:37.742371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:50:38.205965 run create_hlr_db(pid=24213): Launched 22:50:38.319141 bus /gobi_6: Setting Powered False 22:50:39.379571 run create_hlr_db(pid=24213): Terminated: ok {rc=0} 22:50:39.825658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24220): Launched 22:50:40.147599 run osmo-hlr_10.42.42.2(pid=24221): Launched 22:50:40.269513 run osmo-stp_10.42.42.5: Starting osmo-stp 22:50:40.829467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24223): Launched 22:50:41.149247 run osmo-stp_10.42.42.5(pid=24224): Launched 22:50:41.270721 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:50:41.825451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24226): Launched 22:50:41.947759 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:50:42.218657 run patchelf(pid=24227): Launched 22:50:42.396175 run osmo-stp_10.42.42.5(pid=24224): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24224)] 22:50:42.531888 run osmo-stp_10.42.42.5(pid=24224): stdout: | (launched: 2022-12-08_22:50:41.091245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:42.669061 run osmo-stp_10.42.42.5(pid=24224): stderr: | 20221208225041282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225041282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225041283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225041283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225041283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225041283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225041284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:42.806195 run osmo-stp_10.42.42.5(pid=24224): stdout: | (launched: 2022-12-08_22:50:41.091245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:42.939246 run osmo-stp_10.42.42.5(pid=24224): stderr: | 20221208225041282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225041282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225041283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225041283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225041283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225041283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225041284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:43.095227 run patchelf(pid=24227): Terminating (SIGINT) 22:50:43.275469 run patchelf(pid=24227): Terminated: ok {rc=0} 22:50:43.404683 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24224): Process ended prematurely: osmo-stp_10.42.42.5(pid=24224) [trial-2350↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24224)] [trial-2350↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:50:43.414248 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:50:43.442726 run osmo-hlr_10.42.42.2(pid=24221): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24221)] 22:50:43.493384 run osmo-hlr_10.42.42.2(pid=24221): stdout: | (launched: 2022-12-08_22:50:40.089508) 22:50:43.545776 run osmo-hlr_10.42.42.2(pid=24221): stderr: | 20221208225040287 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225040287 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225040287 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225040287 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225040287 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225040287 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225040300 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225040308 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225040308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225040308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:50:43.598807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24220): Terminating (SIGTERM) 22:50:43.641081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24223): Terminating (SIGTERM) 22:50:43.683423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24226): Terminating (SIGTERM) 22:50:43.726026 --- ParallelTerminationStrategy: PID 24220 died... 22:50:43.746339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24220): Terminated: ok {rc=0} 22:50:43.793327 --- ParallelTerminationStrategy: PID 24223 died... 22:50:43.813274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24223): Terminated: ok {rc=0} 22:50:43.860451 --- ParallelTerminationStrategy: PID 24226 died... 22:50:43.880251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24226): Terminated: ok {rc=0} 22:50:43.968403 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 22:50:45.262066 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:50:45.269751 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:50:45.295161 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:50:45.330477 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:50:45.383355 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:50:45.406730 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:50:45.442156 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:50:46.021387 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2350 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:50:46.028616 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:46.042083 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:50:46.104829 tst switch_tch_pdch.py: using LAC 17295 22:50:46.248494 tst switch_tch_pdch.py: using RAC 210 22:50:46.373150 tst switch_tch_pdch.py: using CellId 17295 22:50:46.509375 tst switch_tch_pdch.py: using BVCI 17296 22:50:46.621140 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:46.633381 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:46.645541 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:46.659107 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:46.671977 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:46.683959 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:46.697584 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:46.709792 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:50:46.823896 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:50:46.941456 tst switch_tch_pdch.py:51: start network... 22:50:47.146626 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:50:47.656871 run create_hlr_db(pid=24231): Launched 22:50:47.787278 bus /gobi_6: Setting Powered False 22:50:48.850501 run create_hlr_db(pid=24231): Terminated: ok {rc=0} 22:50:49.295614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24233): Launched 22:50:49.614577 run osmo-hlr_10.42.42.2(pid=24234): Launched 22:50:49.734811 run osmo-stp_10.42.42.5: Starting osmo-stp 22:50:50.286946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24236): Launched 22:50:50.604466 run osmo-stp_10.42.42.5(pid=24237): Launched 22:50:50.725249 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:50:51.274566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24239): Launched 22:50:51.396240 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:50:51.666051 run patchelf(pid=24240): Launched 22:50:51.843005 run osmo-stp_10.42.42.5(pid=24237): ERR: Terminated: ERROR {rc=1} [trial-2350↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24237)] 22:50:51.979501 run osmo-stp_10.42.42.5(pid=24237): stdout: | (launched: 2022-12-08_22:50:50.546592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:52.116668 run osmo-stp_10.42.42.5(pid=24237): stderr: | 20221208225050739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225050739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225050740 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225050740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225050741 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225050741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225050741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:52.254586 run osmo-stp_10.42.42.5(pid=24237): stdout: | (launched: 2022-12-08_22:50:50.546592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:52.385760 run osmo-stp_10.42.42.5(pid=24237): stderr: | 20221208225050739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225050739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225050740 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225050740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225050741 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225050741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225050741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:52.541698 run patchelf(pid=24240): Terminating (SIGINT) 22:50:52.721425 run patchelf(pid=24240): Terminated: ok {rc=0} 22:50:52.850434 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24237): Process ended prematurely: osmo-stp_10.42.42.5(pid=24237) [trial-2350↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24237)] [trial-2350↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:50:52.859943 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 22:50:52.888271 run osmo-hlr_10.42.42.2(pid=24234): ERR: Terminated: ERROR {rc=237} [trial-2350↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24234)] 22:50:52.939765 run osmo-hlr_10.42.42.2(pid=24234): stdout: | (launched: 2022-12-08_22:50:49.556490) 22:50:52.992416 run osmo-hlr_10.42.42.2(pid=24234): stderr: | 20221208225049758 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225049758 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225049759 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225049759 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225049759 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225049759 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225049772 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225049781 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225049782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225049782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:50:53.045540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24233): Terminating (SIGTERM) 22:50:53.087786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24236): Terminating (SIGTERM) 22:50:53.130520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24239): Terminating (SIGTERM) 22:50:53.173182 --- ParallelTerminationStrategy: PID 24233 died... 22:50:53.193570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24233): Terminated: ok {rc=0} 22:50:53.240308 --- ParallelTerminationStrategy: PID 24236 died... 22:50:53.260179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24236): Terminated: ok {rc=0} 22:50:53.306770 --- ParallelTerminationStrategy: PID 24239 died... 22:50:53.326563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24239): Terminated: ok {rc=0} 22:50:53.415273 bus /gobi_0: Setting Powered False 22:50:54.515964 bus /gobi_0: Setting Powered False 22:50:55.632918 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 sms:nanobts+band-900 --------------------------------------------------------------------- 22:50:56.881065 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:50:56.886255 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 22:50:56.919359 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 22:50:56.946493 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 22:50:56.998960 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 22:50:57.031662 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 22:50:57.058886 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 22:50:57.606924 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 22:50:57.611939 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:50:57.623095 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 22:50:57.668578 tst mo_mt_sms.py: using LAC 17296 22:50:57.787910 tst mo_mt_sms.py: using RAC 211 22:50:57.909685 tst mo_mt_sms.py: using CellId 17296 22:50:58.026218 tst mo_mt_sms.py: using BVCI 17297 22:50:58.136901 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:50:58.147675 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:50:58.158211 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:50:58.169152 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:50:58.179866 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:50:58.190889 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 22:50:58.309478 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 22:50:58.427704 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:50:58.920021 run create_hlr_db(pid=24244): Launched 22:50:59.049910 bus /gobi_6: Setting Powered False 22:51:00.113941 run create_hlr_db(pid=24244): Terminated: ok {rc=0} 22:51:00.541059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24246): Launched 22:51:00.842504 run osmo-hlr_10.42.42.2(pid=24247): Launched 22:51:01.062084 run osmo-stp_10.42.42.5: Starting osmo-stp 22:51:01.746739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24249): Launched 22:51:02.054204 run osmo-stp_10.42.42.5(pid=24250): Launched 22:51:02.269328 run osmo-msc_10.42.42.6: Starting osmo-msc 22:51:02.827738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24252): Launched 22:51:03.127775 run osmo-msc_10.42.42.6(pid=24253): Launched 22:51:03.294864 run osmo-stp_10.42.42.5(pid=24250): ERR: Terminated: ERROR {rc=1} [trial-2350↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24250)] 22:51:03.425266 run osmo-stp_10.42.42.5(pid=24250): stdout: | (launched: 2022-12-08_22:51:01.995231) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:03.552533 run osmo-stp_10.42.42.5(pid=24250): stderr: | 20221208225102340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225102340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225102340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225102349 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225102349 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225102349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225102349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:03.678188 run osmo-stp_10.42.42.5(pid=24250): stdout: | (launched: 2022-12-08_22:51:01.995231) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:03.797675 run osmo-stp_10.42.42.5(pid=24250): stderr: | 20221208225102340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225102340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225102340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225102349 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225102349 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225102349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225102349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:03.940577 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=24250): Process ended prematurely: osmo-stp_10.42.42.5(pid=24250) [trial-2350↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24250)] [trial-2350↪sms:nanobts+band-900↪mo_mt_sms.py:16] 22:51:03.948990 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 22:51:03.975926 run osmo-hlr_10.42.42.2(pid=24247): ERR: Terminated: ERROR {rc=237} [trial-2350↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24247)] 22:51:04.025179 run osmo-hlr_10.42.42.2(pid=24247): stdout: | (launched: 2022-12-08_22:51:00.783985) 22:51:04.075861 run osmo-hlr_10.42.42.2(pid=24247): stderr: | 20221208225101097 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225101097 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225101097 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225101098 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225101098 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225101099 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225101116 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225101136 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225101136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225101136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:51:04.146406 run osmo-msc_10.42.42.6(pid=24253): ERR: Terminated: ERROR {rc=2} [trial-2350↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24253)] 22:51:04.195531 run osmo-msc_10.42.42.6(pid=24253): stdout: | (launched: 2022-12-08_22:51:03.072797) 22:51:04.246237 run osmo-msc_10.42.42.6(pid=24253): stderr: | 20221208225103341 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208225103341 DLGLOBAL DEBUG validating counter group 0x7fe8c3510c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208225103341 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208225103341 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208225103341 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208225103342 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208225103343 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208225103344 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208225103344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208225103344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:51:04.297118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24246): Terminating (SIGTERM) 22:51:04.337670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24249): Terminating (SIGTERM) 22:51:04.378226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24252): Terminating (SIGTERM) 22:51:04.419005 --- ParallelTerminationStrategy: PID 24246 died... 22:51:04.438447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24246): Terminated: ok {rc=0} 22:51:04.483783 --- ParallelTerminationStrategy: PID 24249 died... 22:51:04.503091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24249): Terminated: ok {rc=0} 22:51:04.548398 --- ParallelTerminationStrategy: PID 24252 died... 22:51:04.567419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24252): Terminated: ok {rc=0} 22:51:04.655483 bus /sierra_3: Setting Powered False 22:51:05.756299 bus /sierra_3: Setting Powered False 22:51:06.872246 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 22:51:08.108493 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:51:08.113519 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 22:51:08.146444 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 22:51:08.153327 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 22:51:08.188762 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 22:51:08.221129 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 22:51:08.227949 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 22:51:08.749270 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2350 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 22:51:08.754325 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 22:51:08.765540 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 22:51:08.814543 tst assert_extension.py: using LAC 17297 22:51:08.941876 tst assert_extension.py: using RAC 212 22:51:09.068443 tst assert_extension.py: using CellId 17297 22:51:09.193655 tst assert_extension.py: using BVCI 17298 22:51:09.310189 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 22:51:09.425745 tst assert_extension.py:10: start nitb and bts... 22:51:09.639919 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:51:10.289138 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24258): Launched 22:51:10.608844 run osmo-nitb_10.42.42.2(pid=24259): Launched 22:51:10.785182 run osmo-nitb_10.42.42.2(pid=24259): ERR: Terminated: ERROR {rc=2} [trial-2350↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24259)] 22:51:10.929280 run osmo-nitb_10.42.42.2(pid=24259): stdout: | (launched: 2022-12-08_22:51:10.550811) 22:51:11.074676 run osmo-nitb_10.42.42.2(pid=24259): stderr: | (launched: 2022-12-08_22:51:10.598775) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:51:11.219933 run osmo-nitb_10.42.42.2(pid=24259): stdout: | (launched: 2022-12-08_22:51:10.550811) 22:51:11.359812 run osmo-nitb_10.42.42.2(pid=24259): stderr: | (launched: 2022-12-08_22:51:10.598775) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3c9519268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24259): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24259) [trial-2350↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24259)] 22:51:11.728794 tst osmo-nitb_10.42.42.2(pid=24259): stdout: | (launched: 2022-12-08_22:51:10.550811) 22:51:11.858433 tst osmo-nitb_10.42.42.2(pid=24259): stderr: | (launched: 2022-12-08_22:51:10.598775) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:51:12.010878 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=24259): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24259) [trial-2350↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24259)] [trial-2350↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 22:51:12.019912 tst assert_extension.py:12: Test FAILED (3.3 sec) 22:51:12.027004 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24258): Terminating (SIGTERM) 22:51:12.238204 --- ParallelTerminationStrategy: PID 24258 died... 22:51:12.260346 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24258): Terminated: ok {rc=0} 22:51:12.349392 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 ussd:nanobts+band-900 --------------------------------------------------------------------- 22:51:13.524693 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:51:13.529514 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 22:51:13.563334 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 22:51:13.590659 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 22:51:13.627798 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 22:51:13.660769 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 22:51:13.687755 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 22:51:14.215088 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2350 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 22:51:14.221291 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:51:14.232817 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 22:51:14.280541 tst assert_extension.py: using LAC 17298 22:51:14.406485 tst assert_extension.py: using RAC 213 22:51:14.530398 tst assert_extension.py: using CellId 17298 22:51:14.653621 tst assert_extension.py: using BVCI 17299 22:51:14.769595 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:51:14.780606 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:51:14.791606 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:51:14.802499 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:51:14.813481 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:51:14.824310 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 22:51:14.936547 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:51:15.397417 run create_hlr_db(pid=24263): Launched 22:51:15.513445 bus /sierra_2: Setting Powered False 22:51:16.576466 run create_hlr_db(pid=24263): Terminated: ok {rc=0} 22:51:17.034208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24265): Launched 22:51:17.353465 run osmo-hlr_10.42.42.2(pid=24266): Launched 22:51:17.469598 run osmo-stp_10.42.42.5: Starting osmo-stp 22:51:17.988785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24268): Launched 22:51:18.286998 run osmo-stp_10.42.42.5(pid=24269): Launched 22:51:18.401686 run osmo-msc_10.42.42.6: Starting osmo-msc 22:51:18.940077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24271): Launched 22:51:19.237754 run osmo-msc_10.42.42.6(pid=24272): Launched 22:51:19.405127 run osmo-stp_10.42.42.5(pid=24269): ERR: Terminated: ERROR {rc=1} [trial-2350↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24269)] 22:51:19.531896 run osmo-stp_10.42.42.5(pid=24269): stdout: | (launched: 2022-12-08_22:51:18.232036) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:19.658575 run osmo-stp_10.42.42.5(pid=24269): stderr: | 20221208225118402 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225118402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225118403 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225118403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225118403 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225118404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225118404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:19.783999 run osmo-stp_10.42.42.5(pid=24269): stdout: | (launched: 2022-12-08_22:51:18.232036) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:19.902953 run osmo-stp_10.42.42.5(pid=24269): stderr: | 20221208225118402 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225118402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225118403 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225118403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225118403 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225118404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225118404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:20.045735 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=24269): Process ended prematurely: osmo-stp_10.42.42.5(pid=24269) [trial-2350↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24269)] [trial-2350↪ussd:nanobts+band-900↪assert_extension.py:17] 22:51:20.053973 tst assert_extension.py:17: Test FAILED (5.8 sec) 22:51:20.080929 run osmo-hlr_10.42.42.2(pid=24266): ERR: Terminated: ERROR {rc=237} [trial-2350↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24266)] 22:51:20.129894 run osmo-hlr_10.42.42.2(pid=24266): stdout: | (launched: 2022-12-08_22:51:17.298720) 22:51:20.180490 run osmo-hlr_10.42.42.2(pid=24266): stderr: | 20221208225117473 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225117473 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225117473 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225117473 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225117473 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225117473 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225117485 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225117493 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225117494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225117494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:51:20.251085 run osmo-msc_10.42.42.6(pid=24272): ERR: Terminated: ERROR {rc=2} [trial-2350↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24272)] 22:51:20.299855 run osmo-msc_10.42.42.6(pid=24272): stdout: | (launched: 2022-12-08_22:51:19.183291) 22:51:20.350247 run osmo-msc_10.42.42.6(pid=24272): stderr: | 20221208225119451 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208225119451 DLGLOBAL DEBUG validating counter group 0x7fb5519d4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208225119451 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208225119451 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208225119452 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208225119452 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208225119454 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208225119454 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208225119454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208225119454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:51:20.401495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24265): Terminating (SIGTERM) 22:51:20.441967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24268): Terminating (SIGTERM) 22:51:20.482608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24271): Terminating (SIGTERM) 22:51:20.523432 --- ParallelTerminationStrategy: PID 24265 died... 22:51:20.542772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24265): Terminated: ok {rc=0} 22:51:20.587966 --- ParallelTerminationStrategy: PID 24268 died... 22:51:20.606727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24268): Terminated: ok {rc=0} 22:51:20.651679 --- ParallelTerminationStrategy: PID 24271 died... 22:51:20.670511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24271): Terminated: ok {rc=0} 22:51:20.757913 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:51:21.971385 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:51:21.979073 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:51:22.011696 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:51:22.038140 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:51:22.089399 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:51:22.121346 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:51:22.148157 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:51:22.698729 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:51:22.748079 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:22.759203 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:51:22.829477 tst mo_mt_call.py: using LAC 17299 22:51:22.957731 tst mo_mt_call.py: using RAC 214 22:51:23.086585 tst mo_mt_call.py: using CellId 17299 22:51:23.212711 tst mo_mt_call.py: using BVCI 17300 22:51:23.332540 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:23.344468 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:23.356057 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:23.368052 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:23.380011 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:23.391857 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:51:23.510899 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:51:23.630573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:51:24.133540 run create_hlr_db(pid=24277): Launched 22:51:24.265714 bus /sierra_2: Setting Powered False 22:51:25.330062 run create_hlr_db(pid=24277): Terminated: ok {rc=0} 22:51:25.765058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24279): Launched 22:51:26.068735 run osmo-hlr_10.42.42.2(pid=24280): Launched 22:51:26.184186 run osmo-stp_10.42.42.5: Starting osmo-stp 22:51:26.721400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24283): Launched 22:51:27.025581 run osmo-stp_10.42.42.5(pid=24284): Launched 22:51:27.142184 run osmo-msc_10.42.42.6: Starting osmo-msc 22:51:27.706231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24286): Launched 22:51:28.009070 run osmo-msc_10.42.42.6(pid=24287): Launched 22:51:28.178425 run osmo-stp_10.42.42.5(pid=24284): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24284)] 22:51:28.307730 run osmo-stp_10.42.42.5(pid=24284): stdout: | (launched: 2022-12-08_22:51:26.970193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:28.437316 run osmo-stp_10.42.42.5(pid=24284): stderr: | 20221208225127139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225127139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225127140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225127140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225127141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225127141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225127141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:28.564143 run osmo-stp_10.42.42.5(pid=24284): stdout: | (launched: 2022-12-08_22:51:26.970193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:28.685293 run osmo-stp_10.42.42.5(pid=24284): stderr: | 20221208225127139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225127139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225127140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225127140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225127141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225127141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225127141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:28.829871 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24284): Process ended prematurely: osmo-stp_10.42.42.5(pid=24284) [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24284)] [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:51:28.838816 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:51:28.865832 run osmo-hlr_10.42.42.2(pid=24280): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24280)] 22:51:28.914465 run osmo-hlr_10.42.42.2(pid=24280): stdout: | (launched: 2022-12-08_22:51:26.013497) 22:51:28.964637 run osmo-hlr_10.42.42.2(pid=24280): stderr: | 20221208225126191 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225126191 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225126191 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225126191 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225126191 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225126191 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225126203 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225126211 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225126211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225126211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:51:29.034628 run osmo-msc_10.42.42.6(pid=24287): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24287)] 22:51:29.083070 run osmo-msc_10.42.42.6(pid=24287): stdout: | (launched: 2022-12-08_22:51:27.953392) 22:51:29.133938 run osmo-msc_10.42.42.6(pid=24287): stderr: | 20221208225128224 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208225128224 DLGLOBAL DEBUG validating counter group 0x7f0e7aaa6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208225128224 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208225128224 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208225128224 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208225128224 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208225128226 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208225128226 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208225128227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208225128227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:51:29.184331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24279): Terminating (SIGTERM) 22:51:29.224136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24283): Terminating (SIGTERM) 22:51:29.264116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24286): Terminating (SIGTERM) 22:51:29.304480 --- ParallelTerminationStrategy: PID 24279 died... 22:51:29.323755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24279): Terminated: ok {rc=0} 22:51:29.369232 --- ParallelTerminationStrategy: PID 24283 died... 22:51:29.388573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24283): Terminated: ok {rc=0} 22:51:29.433389 --- ParallelTerminationStrategy: PID 24286 died... 22:51:29.451939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24286): Terminated: ok {rc=0} 22:51:29.538314 bus /sierra_3: Setting Powered False 22:51:30.639144 bus /sierra_3: Setting Powered False 22:51:31.763702 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:51:32.928826 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:32.941630 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:51:33.010735 tst mo_mt_call_osmux.py: using LAC 17300 22:51:33.137920 tst mo_mt_call_osmux.py: using RAC 215 22:51:33.265430 tst mo_mt_call_osmux.py: using CellId 17300 22:51:33.392682 tst mo_mt_call_osmux.py: using BVCI 17301 22:51:33.510758 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:33.522574 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:33.534007 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:33.545679 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:33.557480 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:33.569094 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:51:33.686418 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:51:33.806420 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:51:34.311329 run create_hlr_db(pid=24289): Launched 22:51:34.443593 bus /sierra_2: Setting Powered False 22:51:35.505771 run create_hlr_db(pid=24289): Terminated: ok {rc=0} 22:51:35.956805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24291): Launched 22:51:36.262135 run osmo-hlr_10.42.42.2(pid=24292): Launched 22:51:36.378460 run osmo-stp_10.42.42.5: Starting osmo-stp 22:51:36.916641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24294): Launched 22:51:37.221700 run osmo-stp_10.42.42.5(pid=24295): Launched 22:51:37.337981 run osmo-msc_10.42.42.6: Starting osmo-msc 22:51:37.890540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24297): Launched 22:51:38.194357 run osmo-msc_10.42.42.6(pid=24298): Launched 22:51:38.364921 run osmo-stp_10.42.42.5(pid=24295): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24295)] 22:51:38.496155 run osmo-stp_10.42.42.5(pid=24295): stdout: | (launched: 2022-12-08_22:51:37.166035) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:38.627599 run osmo-stp_10.42.42.5(pid=24295): stderr: | 20221208225137335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225137335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225137335 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225137336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225137336 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225137336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225137336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:38.755438 run osmo-stp_10.42.42.5(pid=24295): stdout: | (launched: 2022-12-08_22:51:37.166035) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:38.876727 run osmo-stp_10.42.42.5(pid=24295): stderr: | 20221208225137335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225137335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225137335 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225137336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225137336 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225137336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225137336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:39.022421 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24295): Process ended prematurely: osmo-stp_10.42.42.5(pid=24295) [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24295)] [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:51:39.031343 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:51:39.058844 run osmo-hlr_10.42.42.2(pid=24292): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24292)] 22:51:39.107568 run osmo-hlr_10.42.42.2(pid=24292): stdout: | (launched: 2022-12-08_22:51:36.206473) 22:51:39.157841 run osmo-hlr_10.42.42.2(pid=24292): stderr: | 20221208225136381 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225136381 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225136381 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225136381 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225136381 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225136381 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225136393 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225136402 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225136402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225136402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:51:39.228291 run osmo-msc_10.42.42.6(pid=24298): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24298)] 22:51:39.277140 run osmo-msc_10.42.42.6(pid=24298): stdout: | (launched: 2022-12-08_22:51:38.138423) 22:51:39.327210 run osmo-msc_10.42.42.6(pid=24298): stderr: | 20221208225138409 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208225138409 DLGLOBAL DEBUG validating counter group 0x7fa85f083c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208225138410 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208225138410 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208225138410 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208225138410 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208225138412 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208225138412 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208225138412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208225138412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:51:39.378009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24291): Terminating (SIGTERM) 22:51:39.418358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24294): Terminating (SIGTERM) 22:51:39.458843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24297): Terminating (SIGTERM) 22:51:39.499702 --- ParallelTerminationStrategy: PID 24291 died... 22:51:39.519261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24291): Terminated: ok {rc=0} 22:51:39.564717 --- ParallelTerminationStrategy: PID 24294 died... 22:51:39.583766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24294): Terminated: ok {rc=0} 22:51:39.629165 --- ParallelTerminationStrategy: PID 24297 died... 22:51:39.648090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24297): Terminated: ok {rc=0} 22:51:39.735439 bus /sierra_3: Setting Powered False 22:51:40.836346 bus /sierra_3: Setting Powered False 22:51:41.953574 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:51:43.205849 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:51:43.212884 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:51:43.245119 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:51:43.271066 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:51:43.323425 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:51:43.355157 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:51:43.381187 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:51:43.934737 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:51:43.989429 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:44.001290 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:51:44.069117 tst mo_mt_call.py: using LAC 17301 22:51:44.188817 tst mo_mt_call.py: using RAC 216 22:51:44.307213 tst mo_mt_call.py: using CellId 17301 22:51:44.426351 tst mo_mt_call.py: using BVCI 17302 22:51:44.538343 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:44.549614 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:44.561078 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:44.572548 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:44.584464 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:44.595659 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:51:44.713788 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:51:44.832358 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:51:45.334317 run create_hlr_db(pid=24303): Launched 22:51:45.465975 bus /sierra_2: Setting Powered False 22:51:46.529648 run create_hlr_db(pid=24303): Terminated: ok {rc=0} 22:51:46.991358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24305): Launched 22:51:47.327062 run osmo-hlr_10.42.42.2(pid=24306): Launched 22:51:47.451471 run osmo-stp_10.42.42.5: Starting osmo-stp 22:51:48.010300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24308): Launched 22:51:48.334380 run osmo-stp_10.42.42.5(pid=24309): Launched 22:51:48.458660 run osmo-msc_10.42.42.6: Starting osmo-msc 22:51:49.047203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24311): Launched 22:51:49.372020 run osmo-msc_10.42.42.6(pid=24312): Launched 22:51:49.554469 run osmo-stp_10.42.42.5(pid=24309): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24309)] 22:51:49.693062 run osmo-stp_10.42.42.5(pid=24309): stdout: | (launched: 2022-12-08_22:51:48.275662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:49.832363 run osmo-stp_10.42.42.5(pid=24309): stderr: | 20221208225148469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225148469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225148470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225148470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225148471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225148471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225148471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:49.969392 run osmo-stp_10.42.42.5(pid=24309): stdout: | (launched: 2022-12-08_22:51:48.275662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:50.099032 run osmo-stp_10.42.42.5(pid=24309): stderr: | 20221208225148469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225148469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225148470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225148470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225148471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225148471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225148471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:50.254121 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24309): Process ended prematurely: osmo-stp_10.42.42.5(pid=24309) [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24309)] [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:51:50.263783 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:51:50.291880 run osmo-hlr_10.42.42.2(pid=24306): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24306)] 22:51:50.342748 run osmo-hlr_10.42.42.2(pid=24306): stdout: | (launched: 2022-12-08_22:51:47.268210) 22:51:50.395739 run osmo-hlr_10.42.42.2(pid=24306): stderr: | 20221208225147467 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225147467 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225147467 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225147467 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225147467 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225147467 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225147479 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225147487 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225147487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225147488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:51:50.468886 run osmo-msc_10.42.42.6(pid=24312): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24312)] 22:51:50.519383 run osmo-msc_10.42.42.6(pid=24312): stdout: | (launched: 2022-12-08_22:51:49.312703) 22:51:50.571456 run osmo-msc_10.42.42.6(pid=24312): stderr: | 20221208225149633 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208225149633 DLGLOBAL DEBUG validating counter group 0x7f73cce56c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208225149633 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208225149633 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208225149634 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208225149634 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208225149635 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208225149636 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208225149636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208225149636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:51:50.624236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24305): Terminating (SIGTERM) 22:51:50.666575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24308): Terminating (SIGTERM) 22:51:50.708764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24311): Terminating (SIGTERM) 22:51:50.751418 --- ParallelTerminationStrategy: PID 24305 died... 22:51:50.771659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24305): Terminated: ok {rc=0} 22:51:50.818638 --- ParallelTerminationStrategy: PID 24308 died... 22:51:50.838393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24308): Terminated: ok {rc=0} 22:51:50.885257 --- ParallelTerminationStrategy: PID 24311 died... 22:51:50.904880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24311): Terminated: ok {rc=0} 22:51:50.994743 bus /sierra_3: Setting Powered False 22:51:52.095523 bus /sierra_3: Setting Powered False 22:51:53.213842 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:51:54.363995 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:54.376243 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:51:54.444443 tst mo_mt_call_osmux.py: using LAC 17302 22:51:54.572850 tst mo_mt_call_osmux.py: using RAC 217 22:51:54.700381 tst mo_mt_call_osmux.py: using CellId 17302 22:51:54.827009 tst mo_mt_call_osmux.py: using BVCI 17303 22:51:54.945476 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:54.957395 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:54.968845 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:54.980217 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:54.991696 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:55.003173 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:51:55.121826 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:51:55.240710 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:51:55.744100 run create_hlr_db(pid=24314): Launched 22:51:55.875464 bus /sierra_2: Setting Powered False 22:51:56.939533 run create_hlr_db(pid=24314): Terminated: ok {rc=0} 22:51:57.374230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24316): Launched 22:51:57.677537 run osmo-hlr_10.42.42.2(pid=24317): Launched 22:51:57.793647 run osmo-stp_10.42.42.5: Starting osmo-stp 22:51:58.330283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24319): Launched 22:51:58.653472 run osmo-stp_10.42.42.5(pid=24320): Launched 22:51:58.781274 run osmo-msc_10.42.42.6: Starting osmo-msc 22:51:59.373149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24322): Launched 22:51:59.698672 run osmo-msc_10.42.42.6(pid=24323): Launched 22:51:59.878699 run osmo-stp_10.42.42.5(pid=24320): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24320)] 22:52:00.016159 run osmo-stp_10.42.42.5(pid=24320): stdout: | (launched: 2022-12-08_22:51:58.594828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:00.153911 run osmo-stp_10.42.42.5(pid=24320): stderr: | 20221208225158786 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225158786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225158786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225158786 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225158787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225158787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225158787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:00.290644 run osmo-stp_10.42.42.5(pid=24320): stdout: | (launched: 2022-12-08_22:51:58.594828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:00.420537 run osmo-stp_10.42.42.5(pid=24320): stderr: | 20221208225158786 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225158786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225158786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225158786 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225158787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225158787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225158787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:00.576059 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24320): Process ended prematurely: osmo-stp_10.42.42.5(pid=24320) [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24320)] [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:52:00.586043 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:52:00.614473 run osmo-hlr_10.42.42.2(pid=24317): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24317)] 22:52:00.665387 run osmo-hlr_10.42.42.2(pid=24317): stdout: | (launched: 2022-12-08_22:51:57.622438) 22:52:00.718489 run osmo-hlr_10.42.42.2(pid=24317): stderr: | 20221208225157796 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225157796 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225157796 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225157796 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225157796 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225157796 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225157809 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225157817 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225157817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225157818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:52:00.792311 run osmo-msc_10.42.42.6(pid=24323): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24323)] 22:52:00.856650 run osmo-msc_10.42.42.6(pid=24323): stdout: | (launched: 2022-12-08_22:51:59.639381) 22:52:00.924600 run osmo-msc_10.42.42.6(pid=24323): stderr: | 20221208225159961 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208225159961 DLGLOBAL DEBUG validating counter group 0x7fe9a48e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208225159961 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208225159961 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208225159961 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208225159961 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208225159963 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208225159963 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208225159963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208225159964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:52:00.979230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24316): Terminating (SIGTERM) 22:52:01.023266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24319): Terminating (SIGTERM) 22:52:01.068773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24322): Terminating (SIGTERM) 22:52:01.114806 --- ParallelTerminationStrategy: PID 24316 died... 22:52:01.135419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24316): Terminated: ok {rc=0} 22:52:01.185090 --- ParallelTerminationStrategy: PID 24319 died... 22:52:01.205515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24319): Terminated: ok {rc=0} 22:52:01.253735 --- ParallelTerminationStrategy: PID 24322 died... 22:52:01.274005 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24322): Terminated: ok {rc=0} 22:52:01.364764 bus /sierra_3: Setting Powered False 22:52:02.463016 bus /sierra_3: Setting Powered False 22:52:03.580213 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:52:04.827471 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:52:04.834631 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:52:04.866525 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:52:04.892806 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:52:04.943530 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:52:04.975304 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:52:05.001400 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:52:05.556029 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:52:05.607674 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:05.618714 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:52:05.682428 tst mo_mt_call.py: using LAC 17303 22:52:05.805155 tst mo_mt_call.py: using RAC 218 22:52:05.923645 tst mo_mt_call.py: using CellId 17303 22:52:06.044440 tst mo_mt_call.py: using BVCI 17304 22:52:06.156746 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:06.168268 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:06.179333 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:06.190452 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:06.202063 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:06.213225 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:52:06.330115 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:52:06.445776 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:52:06.916650 run create_hlr_db(pid=24328): Launched 22:52:07.032848 bus /sierra_2: Setting Powered False 22:52:08.094589 run create_hlr_db(pid=24328): Terminated: ok {rc=0} 22:52:08.519465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24330): Launched 22:52:08.823721 run osmo-hlr_10.42.42.2(pid=24331): Launched 22:52:08.939611 run osmo-stp_10.42.42.5: Starting osmo-stp 22:52:09.475378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24333): Launched 22:52:09.778854 run osmo-stp_10.42.42.5(pid=24334): Launched 22:52:09.894301 run osmo-msc_10.42.42.6: Starting osmo-msc 22:52:10.446499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24336): Launched 22:52:10.749881 run osmo-msc_10.42.42.6(pid=24337): Launched 22:52:10.921264 run osmo-stp_10.42.42.5(pid=24334): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24334)] 22:52:11.051655 run osmo-stp_10.42.42.5(pid=24334): stdout: | (launched: 2022-12-08_22:52:09.723467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:11.180847 run osmo-stp_10.42.42.5(pid=24334): stderr: | 20221208225209893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225209893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225209893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225209894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225209894 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225209894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225209894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:11.308188 run osmo-stp_10.42.42.5(pid=24334): stdout: | (launched: 2022-12-08_22:52:09.723467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:11.429702 run osmo-stp_10.42.42.5(pid=24334): stderr: | 20221208225209893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225209893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225209893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225209894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225209894 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225209894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225209894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:11.574882 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24334): Process ended prematurely: osmo-stp_10.42.42.5(pid=24334) [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24334)] [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:52:11.583695 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:52:11.610970 run osmo-hlr_10.42.42.2(pid=24331): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24331)] 22:52:11.660106 run osmo-hlr_10.42.42.2(pid=24331): stdout: | (launched: 2022-12-08_22:52:08.768101) 22:52:11.710566 run osmo-hlr_10.42.42.2(pid=24331): stderr: | 20221208225208946 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225208946 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225208946 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225208946 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225208946 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225208946 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225208959 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225208967 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225208967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225208967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:52:11.781177 run osmo-msc_10.42.42.6(pid=24337): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24337)] 22:52:11.830041 run osmo-msc_10.42.42.6(pid=24337): stdout: | (launched: 2022-12-08_22:52:10.694093) 22:52:11.880270 run osmo-msc_10.42.42.6(pid=24337): stderr: | 20221208225210963 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208225210963 DLGLOBAL DEBUG validating counter group 0x7feed1155c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208225210963 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208225210963 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208225210963 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208225210964 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208225210965 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208225210966 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208225210966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208225210966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:52:11.931190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24330): Terminating (SIGTERM) 22:52:11.971465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24333): Terminating (SIGTERM) 22:52:12.011816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24336): Terminating (SIGTERM) 22:52:12.052414 --- ParallelTerminationStrategy: PID 24330 died... 22:52:12.071433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24330): Terminated: ok {rc=0} 22:52:12.116619 --- ParallelTerminationStrategy: PID 24333 died... 22:52:12.135530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24333): Terminated: ok {rc=0} 22:52:12.180531 --- ParallelTerminationStrategy: PID 24336 died... 22:52:12.199415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24336): Terminated: ok {rc=0} 22:52:12.284016 bus /sierra_3: Setting Powered False 22:52:13.380251 bus /sierra_3: Setting Powered False 22:52:14.496613 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:52:15.643420 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:15.655184 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:52:15.720450 tst mo_mt_call_osmux.py: using LAC 17304 22:52:15.844877 tst mo_mt_call_osmux.py: using RAC 219 22:52:15.987167 tst mo_mt_call_osmux.py: using CellId 17304 22:52:16.126418 tst mo_mt_call_osmux.py: using BVCI 17305 22:52:16.249800 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:16.262078 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:16.274238 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:16.286337 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:16.298430 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:16.311014 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:52:16.427542 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:52:16.571913 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:52:17.129422 run create_hlr_db(pid=24339): Launched 22:52:17.293755 bus /sierra_2: Setting Powered False 22:52:18.358412 run create_hlr_db(pid=24339): Terminated: ok {rc=0} 22:52:18.793346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24341): Launched 22:52:19.100728 run osmo-hlr_10.42.42.2(pid=24342): Launched 22:52:19.217873 run osmo-stp_10.42.42.5: Starting osmo-stp 22:52:19.752770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24344): Launched 22:52:20.056776 run osmo-stp_10.42.42.5(pid=24345): Launched 22:52:20.174419 run osmo-msc_10.42.42.6: Starting osmo-msc 22:52:20.723150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24347): Launched 22:52:21.029292 run osmo-msc_10.42.42.6(pid=24348): Launched 22:52:21.199364 run osmo-stp_10.42.42.5(pid=24345): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24345)] 22:52:21.329856 run osmo-stp_10.42.42.5(pid=24345): stdout: | (launched: 2022-12-08_22:52:20.001118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:21.459392 run osmo-stp_10.42.42.5(pid=24345): stderr: | 20221208225220171 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225220171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225220171 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225220172 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225220172 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225220172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225220173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:21.587420 run osmo-stp_10.42.42.5(pid=24345): stdout: | (launched: 2022-12-08_22:52:20.001118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:21.708652 run osmo-stp_10.42.42.5(pid=24345): stderr: | 20221208225220171 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225220171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225220171 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225220172 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225220172 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225220172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225220173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:21.854356 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24345): Process ended prematurely: osmo-stp_10.42.42.5(pid=24345) [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24345)] [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:52:21.863288 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:52:21.890570 run osmo-hlr_10.42.42.2(pid=24342): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24342)] 22:52:21.939376 run osmo-hlr_10.42.42.2(pid=24342): stdout: | (launched: 2022-12-08_22:52:19.044783) 22:52:21.989958 run osmo-hlr_10.42.42.2(pid=24342): stderr: | 20221208225219220 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225219220 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225219220 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225219220 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225219220 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225219221 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225219233 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225219242 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225219242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225219242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:52:22.060742 run osmo-msc_10.42.42.6(pid=24348): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24348)] 22:52:22.109401 run osmo-msc_10.42.42.6(pid=24348): stdout: | (launched: 2022-12-08_22:52:20.972914) 22:52:22.159517 run osmo-msc_10.42.42.6(pid=24348): stderr: | 20221208225221243 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208225221243 DLGLOBAL DEBUG validating counter group 0x7f678be1ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208225221243 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208225221243 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208225221244 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208225221244 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208225221246 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208225221246 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208225221246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208225221246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:52:22.209940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24341): Terminating (SIGTERM) 22:52:22.250293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24344): Terminating (SIGTERM) 22:52:22.290753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24347): Terminating (SIGTERM) 22:52:22.331332 --- ParallelTerminationStrategy: PID 24341 died... 22:52:22.350534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24341): Terminated: ok {rc=0} 22:52:22.395406 --- ParallelTerminationStrategy: PID 24344 died... 22:52:22.414134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24344): Terminated: ok {rc=0} 22:52:22.458782 --- ParallelTerminationStrategy: PID 24347 died... 22:52:22.477477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24347): Terminated: ok {rc=0} 22:52:22.564228 bus /sierra_3: Setting Powered False 22:52:23.664572 bus /sierra_3: Setting Powered False 22:52:24.782348 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:52:26.029990 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:52:26.039127 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:52:26.071639 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:52:26.099220 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:52:26.150848 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:52:26.183375 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:52:26.210336 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:52:26.764155 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:52:26.815903 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:26.827467 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:52:26.895348 tst mo_mt_call.py: using LAC 17305 22:52:27.022745 tst mo_mt_call.py: using RAC 220 22:52:27.149511 tst mo_mt_call.py: using CellId 17305 22:52:27.269356 tst mo_mt_call.py: using BVCI 17306 22:52:27.380301 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:27.391533 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:27.402547 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:27.414276 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:27.426126 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:27.437883 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:52:27.555852 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:52:27.672241 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:52:28.143627 run create_hlr_db(pid=24353): Launched 22:52:28.258909 bus /sierra_2: Setting Powered False 22:52:29.319390 run create_hlr_db(pid=24353): Terminated: ok {rc=0} 22:52:29.762359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24355): Launched 22:52:30.085951 run osmo-hlr_10.42.42.2(pid=24356): Launched 22:52:30.209112 run osmo-stp_10.42.42.5: Starting osmo-stp 22:52:30.766481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24358): Launched 22:52:31.152165 run osmo-stp_10.42.42.5(pid=24359): Launched 22:52:31.371340 run osmo-msc_10.42.42.6: Starting osmo-msc 22:52:32.061121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24361): Launched 22:52:32.375510 run osmo-msc_10.42.42.6(pid=24362): Launched 22:52:32.548552 run osmo-stp_10.42.42.5(pid=24359): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24359)] 22:52:32.682025 run osmo-stp_10.42.42.5(pid=24359): stdout: | (launched: 2022-12-08_22:52:31.073563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:32.810876 run osmo-stp_10.42.42.5(pid=24359): stderr: | 20221208225231394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225231394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225231394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225231395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225231395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225231395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225231395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:32.938800 run osmo-stp_10.42.42.5(pid=24359): stdout: | (launched: 2022-12-08_22:52:31.073563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:33.059841 run osmo-stp_10.42.42.5(pid=24359): stderr: | 20221208225231394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225231394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225231394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225231395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225231395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225231395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225231395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:33.204543 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24359): Process ended prematurely: osmo-stp_10.42.42.5(pid=24359) [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24359)] [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:52:33.213505 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 22:52:33.240462 run osmo-hlr_10.42.42.2(pid=24356): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24356)] 22:52:33.289380 run osmo-hlr_10.42.42.2(pid=24356): stdout: | (launched: 2022-12-08_22:52:30.027378) 22:52:33.339945 run osmo-hlr_10.42.42.2(pid=24356): stderr: | 20221208225230224 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225230224 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225230224 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225230224 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225230224 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225230225 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225230237 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225230246 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225230246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225230246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:52:33.410585 run osmo-msc_10.42.42.6(pid=24362): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24362)] 22:52:33.459511 run osmo-msc_10.42.42.6(pid=24362): stdout: | (launched: 2022-12-08_22:52:32.317847) 22:52:33.510062 run osmo-msc_10.42.42.6(pid=24362): stderr: | 20221208225232587 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208225232587 DLGLOBAL DEBUG validating counter group 0x7fd998509c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208225232587 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208225232587 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208225232587 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208225232587 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208225232589 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208225232589 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208225232590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208225232590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:52:33.560760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24355): Terminating (SIGTERM) 22:52:33.601167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24358): Terminating (SIGTERM) 22:52:33.641564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24361): Terminating (SIGTERM) 22:52:33.682478 --- ParallelTerminationStrategy: PID 24355 died... 22:52:33.701802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24355): Terminated: ok {rc=0} 22:52:33.746996 --- ParallelTerminationStrategy: PID 24358 died... 22:52:33.765915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24358): Terminated: ok {rc=0} 22:52:33.810991 --- ParallelTerminationStrategy: PID 24361 died... 22:52:33.829957 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24361): Terminated: ok {rc=0} 22:52:33.916653 bus /sierra_3: Setting Powered False 22:52:35.018921 bus /sierra_3: Setting Powered False 22:52:36.135333 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:52:37.285224 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:37.297303 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:52:37.370714 tst mo_mt_call_osmux.py: using LAC 17306 22:52:37.498168 tst mo_mt_call_osmux.py: using RAC 221 22:52:37.625174 tst mo_mt_call_osmux.py: using CellId 17306 22:52:37.750804 tst mo_mt_call_osmux.py: using BVCI 17307 22:52:37.868273 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:37.880082 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:37.891523 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:37.902950 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:37.914546 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:37.926023 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:52:38.042017 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:52:38.161798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:52:38.662938 run create_hlr_db(pid=24364): Launched 22:52:38.794247 bus /sierra_2: Setting Powered False 22:52:39.858463 run create_hlr_db(pid=24364): Terminated: ok {rc=0} 22:52:40.291950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24366): Launched 22:52:40.596458 run osmo-hlr_10.42.42.2(pid=24367): Launched 22:52:40.715024 run osmo-stp_10.42.42.5: Starting osmo-stp 22:52:41.239836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24369): Launched 22:52:41.543611 run osmo-stp_10.42.42.5(pid=24370): Launched 22:52:41.658778 run osmo-msc_10.42.42.6: Starting osmo-msc 22:52:42.207512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24372): Launched 22:52:42.511429 run osmo-msc_10.42.42.6(pid=24373): Launched 22:52:42.682195 run osmo-stp_10.42.42.5(pid=24370): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24370)] 22:52:42.812275 run osmo-stp_10.42.42.5(pid=24370): stdout: | (launched: 2022-12-08_22:52:41.487894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:42.942464 run osmo-stp_10.42.42.5(pid=24370): stderr: | 20221208225241658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225241658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225241658 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225241659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225241661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225241661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225241661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:43.070090 run osmo-stp_10.42.42.5(pid=24370): stdout: | (launched: 2022-12-08_22:52:41.487894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:43.191503 run osmo-stp_10.42.42.5(pid=24370): stderr: | 20221208225241658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225241658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225241658 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225241659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225241661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225241661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225241661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:43.336347 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24370): Process ended prematurely: osmo-stp_10.42.42.5(pid=24370) [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24370)] [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:52:43.345416 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:52:43.372544 run osmo-hlr_10.42.42.2(pid=24367): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24367)] 22:52:43.421111 run osmo-hlr_10.42.42.2(pid=24367): stdout: | (launched: 2022-12-08_22:52:40.540840) 22:52:43.471122 run osmo-hlr_10.42.42.2(pid=24367): stderr: | 20221208225240719 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225240719 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225240719 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225240719 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225240719 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225240719 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225240732 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225240740 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225240740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225240740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:52:43.541905 run osmo-msc_10.42.42.6(pid=24373): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24373)] 22:52:43.590157 run osmo-msc_10.42.42.6(pid=24373): stdout: | (launched: 2022-12-08_22:52:42.455754) 22:52:43.640219 run osmo-msc_10.42.42.6(pid=24373): stderr: | 20221208225242728 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208225242728 DLGLOBAL DEBUG validating counter group 0x7fcc6d07ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208225242728 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208225242728 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208225242728 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208225242728 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208225242730 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208225242731 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208225242731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208225242731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:52:43.690621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24366): Terminating (SIGTERM) 22:52:43.731038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24369): Terminating (SIGTERM) 22:52:43.771227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24372): Terminating (SIGTERM) 22:52:43.811662 --- ParallelTerminationStrategy: PID 24366 died... 22:52:43.831006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24366): Terminated: ok {rc=0} 22:52:43.876090 --- ParallelTerminationStrategy: PID 24369 died... 22:52:43.894913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24369): Terminated: ok {rc=0} 22:52:43.939917 --- ParallelTerminationStrategy: PID 24372 died... 22:52:43.958731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24372): Terminated: ok {rc=0} 22:52:44.043803 bus /sierra_3: Setting Powered False 22:52:45.142831 bus /sierra_3: Setting Powered False 22:52:46.261871 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:52:47.514617 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:52:47.522582 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:52:47.555258 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:52:47.582490 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:52:47.637032 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:52:47.670477 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:52:47.697576 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:52:48.248814 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:52:48.300537 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:48.312310 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:52:48.380515 tst mo_mt_call.py: using LAC 17307 22:52:48.507287 tst mo_mt_call.py: using RAC 222 22:52:48.635289 tst mo_mt_call.py: using CellId 17307 22:52:48.763924 tst mo_mt_call.py: using BVCI 17308 22:52:48.881487 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:48.892930 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:48.904420 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:48.915905 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:48.927431 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:48.938874 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:52:49.053641 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:52:49.171478 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:52:49.641856 run create_hlr_db(pid=24378): Launched 22:52:49.759452 bus /sierra_2: Setting Powered False 22:52:50.819864 run create_hlr_db(pid=24378): Terminated: ok {rc=0} 22:52:51.265434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24380): Launched 22:52:51.590972 run osmo-hlr_10.42.42.2(pid=24381): Launched 22:52:51.714860 run osmo-stp_10.42.42.5: Starting osmo-stp 22:52:52.273223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24383): Launched 22:52:52.596861 run osmo-stp_10.42.42.5(pid=24384): Launched 22:52:52.719834 run osmo-msc_10.42.42.6: Starting osmo-msc 22:52:53.307271 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24386): Launched 22:52:53.631657 run osmo-msc_10.42.42.6(pid=24387): Launched 22:52:53.811744 run osmo-stp_10.42.42.5(pid=24384): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24384)] 22:52:53.948831 run osmo-stp_10.42.42.5(pid=24384): stdout: | (launched: 2022-12-08_22:52:52.538056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:54.086709 run osmo-stp_10.42.42.5(pid=24384): stderr: | 20221208225252730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225252730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225252730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225252731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225252731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225252731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225252731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:54.222998 run osmo-stp_10.42.42.5(pid=24384): stdout: | (launched: 2022-12-08_22:52:52.538056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:54.352320 run osmo-stp_10.42.42.5(pid=24384): stderr: | 20221208225252730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225252730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225252730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225252731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225252731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225252731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225252731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:54.507029 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24384): Process ended prematurely: osmo-stp_10.42.42.5(pid=24384) [trial-2350↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24384)] [trial-2350↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:52:54.516484 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:52:54.544426 run osmo-hlr_10.42.42.2(pid=24381): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24381)] 22:52:54.594895 run osmo-hlr_10.42.42.2(pid=24381): stdout: | (launched: 2022-12-08_22:52:51.531853) 22:52:54.647392 run osmo-hlr_10.42.42.2(pid=24381): stderr: | 20221208225251730 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225251730 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225251730 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225251730 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225251731 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225251731 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225251743 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225251751 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225251752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225251752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:52:54.720779 run osmo-msc_10.42.42.6(pid=24387): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24387)] 22:52:54.771304 run osmo-msc_10.42.42.6(pid=24387): stdout: | (launched: 2022-12-08_22:52:53.572528) 22:52:54.823559 run osmo-msc_10.42.42.6(pid=24387): stderr: | 20221208225253894 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208225253895 DLGLOBAL DEBUG validating counter group 0x7f2979f7ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208225253895 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208225253895 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208225253895 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208225253895 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208225253897 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208225253898 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208225253898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208225253898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:52:54.875945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24380): Terminating (SIGTERM) 22:52:54.918270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24383): Terminating (SIGTERM) 22:52:54.960537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24386): Terminating (SIGTERM) 22:52:55.003375 --- ParallelTerminationStrategy: PID 24380 died... 22:52:55.023576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24380): Terminated: ok {rc=0} 22:52:55.070407 --- ParallelTerminationStrategy: PID 24383 died... 22:52:55.090140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24383): Terminated: ok {rc=0} 22:52:55.137155 --- ParallelTerminationStrategy: PID 24386 died... 22:52:55.156833 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24386): Terminated: ok {rc=0} 22:52:55.245035 bus /sierra_3: Setting Powered False 22:52:56.344014 bus /sierra_3: Setting Powered False 22:52:57.460139 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:52:58.606399 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:58.618196 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:52:58.689775 tst mo_mt_call_osmux.py: using LAC 17308 22:52:58.810726 tst mo_mt_call_osmux.py: using RAC 223 22:52:58.930869 tst mo_mt_call_osmux.py: using CellId 17308 22:52:59.050470 tst mo_mt_call_osmux.py: using BVCI 17309 22:52:59.163846 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:59.175270 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:59.186670 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:59.198142 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:59.209574 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:59.220923 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:52:59.337913 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:52:59.456563 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:52:59.959777 run create_hlr_db(pid=24389): Launched 22:53:00.091829 bus /sierra_2: Setting Powered False 22:53:01.171240 run create_hlr_db(pid=24389): Terminated: ok {rc=0} 22:53:01.688805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24427): Launched 22:53:02.033739 run osmo-hlr_10.42.42.2(pid=24435): Launched 22:53:02.218266 run osmo-stp_10.42.42.5: Starting osmo-stp 22:53:03.108029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24481): Launched 22:53:03.566438 run osmo-stp_10.42.42.5(pid=24532): Launched 22:53:03.774455 run osmo-msc_10.42.42.6: Starting osmo-msc 22:53:04.620251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24656): Launched 22:53:04.990707 run osmo-msc_10.42.42.6(pid=24669): Launched 22:53:05.376327 run osmo-stp_10.42.42.5(pid=24532): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24532)] 22:53:05.634658 run osmo-stp_10.42.42.5(pid=24532): stdout: | (launched: 2022-12-08_22:53:03.481745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:05.772896 run osmo-stp_10.42.42.5(pid=24532): stderr: | 20221208225303867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225303867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225303868 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225303868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225303873 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225303873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225303873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:05.910266 run osmo-stp_10.42.42.5(pid=24532): stdout: | (launched: 2022-12-08_22:53:03.481745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:06.041451 run osmo-stp_10.42.42.5(pid=24532): stderr: | 20221208225303867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225303867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225303868 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225303868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225303873 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225303873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225303873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:06.198165 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24532): Process ended prematurely: osmo-stp_10.42.42.5(pid=24532) [trial-2350↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24532)] [trial-2350↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:53:06.208786 tst mo_mt_call_osmux.py:8: Test FAILED (7.6 sec) 22:53:06.238731 run osmo-hlr_10.42.42.2(pid=24435): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24435)] 22:53:06.290979 run osmo-hlr_10.42.42.2(pid=24435): stdout: | (launched: 2022-12-08_22:53:01.958239) 22:53:06.344724 run osmo-hlr_10.42.42.2(pid=24435): stderr: | 20221208225302323 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225302323 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225302323 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225302323 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225302323 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225302323 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225302351 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225302366 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225302366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225302366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:53:06.419694 run osmo-msc_10.42.42.6(pid=24669): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24669)] 22:53:06.471870 run osmo-msc_10.42.42.6(pid=24669): stdout: | (launched: 2022-12-08_22:53:04.917961) 22:53:06.525783 run osmo-msc_10.42.42.6(pid=24669): stderr: | 20221208225305339 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208225305339 DLGLOBAL DEBUG validating counter group 0x7f766cf1cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208225305339 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208225305339 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208225305339 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208225305340 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208225305349 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208225305350 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208225305350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208225305350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:53:06.579942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24427): Terminating (SIGTERM) 22:53:06.624470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24481): Terminating (SIGTERM) 22:53:06.670514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24656): Terminating (SIGTERM) 22:53:06.716359 --- ParallelTerminationStrategy: PID 24427 died... 22:53:06.737631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24427): Terminated: ok {rc=0} 22:53:06.790605 --- ParallelTerminationStrategy: PID 24481 died... 22:53:06.810475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24481): Terminated: ok {rc=0} 22:53:06.858500 --- ParallelTerminationStrategy: PID 24656 died... 22:53:06.878772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24656): Terminated: ok {rc=0} 22:53:06.969405 bus /sierra_3: Setting Powered False 22:53:08.070034 bus /sierra_3: Setting Powered False 22:53:09.187460 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 22:53:10.442233 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:53:10.450208 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 22:53:10.485310 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 22:53:10.515582 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 22:53:10.567526 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 22:53:10.603139 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 22:53:10.630823 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 22:53:11.181540 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 22:53:11.234825 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:11.247624 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:53:11.298922 tst mo_mt_call.py: using LAC 17309 22:53:11.423964 tst mo_mt_call.py: using RAC 224 22:53:11.547955 tst mo_mt_call.py: using CellId 17309 22:53:11.673384 tst mo_mt_call.py: using BVCI 17310 22:53:11.789124 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:11.801729 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:11.813935 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:11.828691 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:11.842116 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:11.854862 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:53:11.978577 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:53:12.098664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:53:12.590944 run create_hlr_db(pid=24676): Launched 22:53:12.754761 bus /sierra_2: Setting Powered False 22:53:13.821468 run create_hlr_db(pid=24676): Terminated: ok {rc=0} 22:53:14.291610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24678): Launched 22:53:14.639527 run osmo-hlr_10.42.42.2(pid=24679): Launched 22:53:14.886757 run osmo-stp_10.42.42.5: Starting osmo-stp 22:53:15.585723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24681): Launched 22:53:15.945754 run osmo-stp_10.42.42.5(pid=24682): Launched 22:53:16.199532 run osmo-msc_10.42.42.6: Starting osmo-msc 22:53:17.066067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24684): Launched 22:53:17.466225 run osmo-msc_10.42.42.6(pid=24685): Launched 22:53:17.915850 run osmo-stp_10.42.42.5(pid=24682): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24682)] 22:53:18.210843 run osmo-stp_10.42.42.5(pid=24682): stdout: | (launched: 2022-12-08_22:53:15.865767) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:18.383429 run osmo-stp_10.42.42.5(pid=24682): stderr: | 20221208225316190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225316190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225316190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225316191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225316191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225316191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225316191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:18.528353 run osmo-stp_10.42.42.5(pid=24682): stdout: | (launched: 2022-12-08_22:53:15.865767) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:18.662015 run osmo-stp_10.42.42.5(pid=24682): stderr: | 20221208225316190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225316190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225316190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225316191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225316191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225316191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225316191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:18.821981 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24682): Process ended prematurely: osmo-stp_10.42.42.5(pid=24682) [trial-2350↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24682)] [trial-2350↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 22:53:18.832596 tst mo_mt_call.py:8: Test FAILED (7.6 sec) 22:53:18.862739 run osmo-hlr_10.42.42.2(pid=24679): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24679)] 22:53:18.915709 run osmo-hlr_10.42.42.2(pid=24679): stdout: | (launched: 2022-12-08_22:53:14.577623) 22:53:18.970497 run osmo-hlr_10.42.42.2(pid=24679): stderr: | 20221208225314894 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225314894 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225314894 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225314894 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225314894 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225314894 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225314915 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225314932 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225314932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225314932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:53:19.047997 run osmo-msc_10.42.42.6(pid=24685): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24685)] 22:53:19.100567 run osmo-msc_10.42.42.6(pid=24685): stdout: | (launched: 2022-12-08_22:53:17.393040) 22:53:19.154838 run osmo-msc_10.42.42.6(pid=24685): stderr: | 20221208225317865 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208225317865 DLGLOBAL DEBUG validating counter group 0x7f05020c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208225317865 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208225317865 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208225317865 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208225317865 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208225317868 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208225317869 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208225317869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208225317869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:53:19.211366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24678): Terminating (SIGTERM) 22:53:19.255868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24681): Terminating (SIGTERM) 22:53:19.302601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24684): Terminating (SIGTERM) 22:53:19.350001 --- ParallelTerminationStrategy: PID 24678 died... 22:53:19.371109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24678): Terminated: ok {rc=0} 22:53:19.421965 --- ParallelTerminationStrategy: PID 24681 died... 22:53:19.442847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24681): Terminated: ok {rc=0} 22:53:19.491484 --- ParallelTerminationStrategy: PID 24684 died... 22:53:19.512572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24684): Terminated: ok {rc=0} 22:53:19.606821 bus /sierra_3: Setting Powered False 22:53:20.710264 bus /sierra_3: Setting Powered False 22:53:21.831072 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 22:53:22.984035 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:22.997407 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:53:23.050871 tst mo_mt_call_osmux.py: using LAC 17310 22:53:23.174285 tst mo_mt_call_osmux.py: using RAC 225 22:53:23.298598 tst mo_mt_call_osmux.py: using CellId 17310 22:53:23.424441 tst mo_mt_call_osmux.py: using BVCI 17311 22:53:23.541406 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:23.553867 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:23.566941 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:23.582725 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:23.596254 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:23.608799 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:53:23.729544 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:53:23.852632 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:53:24.349029 run create_hlr_db(pid=24687): Launched 22:53:24.511678 bus /sierra_2: Setting Powered False 22:53:25.575956 run create_hlr_db(pid=24687): Terminated: ok {rc=0} 22:53:26.014158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24689): Launched 22:53:26.318262 run osmo-hlr_10.42.42.2(pid=24690): Launched 22:53:26.434112 run osmo-stp_10.42.42.5: Starting osmo-stp 22:53:26.967066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24692): Launched 22:53:27.271358 run osmo-stp_10.42.42.5(pid=24693): Launched 22:53:27.387587 run osmo-msc_10.42.42.6: Starting osmo-msc 22:53:27.937747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24695): Launched 22:53:28.243889 run osmo-msc_10.42.42.6(pid=24696): Launched 22:53:28.414859 run osmo-stp_10.42.42.5(pid=24693): ERR: Terminated: ERROR {rc=1} [trial-2350↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24693)] 22:53:28.545087 run osmo-stp_10.42.42.5(pid=24693): stdout: | (launched: 2022-12-08_22:53:27.215812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:28.675002 run osmo-stp_10.42.42.5(pid=24693): stderr: | 20221208225327387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225327388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225327388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225327388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225327389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225327389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225327389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:28.803323 run osmo-stp_10.42.42.5(pid=24693): stdout: | (launched: 2022-12-08_22:53:27.215812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:28.924886 run osmo-stp_10.42.42.5(pid=24693): stderr: | 20221208225327387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225327388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225327388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225327388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225327389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225327389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225327389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:29.070996 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24693): Process ended prematurely: osmo-stp_10.42.42.5(pid=24693) [trial-2350↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24693)] [trial-2350↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 22:53:29.079963 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:53:29.107246 run osmo-hlr_10.42.42.2(pid=24690): ERR: Terminated: ERROR {rc=237} [trial-2350↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24690)] 22:53:29.156250 run osmo-hlr_10.42.42.2(pid=24690): stdout: | (launched: 2022-12-08_22:53:26.262721) 22:53:29.207042 run osmo-hlr_10.42.42.2(pid=24690): stderr: | 20221208225326450 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225326450 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225326450 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225326450 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225326450 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225326450 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225326462 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225326470 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225326470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225326471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:53:29.278027 run osmo-msc_10.42.42.6(pid=24696): ERR: Terminated: ERROR {rc=2} [trial-2350↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24696)] 22:53:29.326692 run osmo-msc_10.42.42.6(pid=24696): stdout: | (launched: 2022-12-08_22:53:28.187605) 22:53:29.377290 run osmo-msc_10.42.42.6(pid=24696): stderr: | 20221208225328460 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208225328460 DLGLOBAL DEBUG validating counter group 0x7fb436e23c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208225328460 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208225328460 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208225328460 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208225328461 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208225328462 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208225328463 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208225328463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208225328463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:53:29.428480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24689): Terminating (SIGTERM) 22:53:29.468936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24692): Terminating (SIGTERM) 22:53:29.509351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24695): Terminating (SIGTERM) 22:53:29.550173 --- ParallelTerminationStrategy: PID 24689 died... 22:53:29.569535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24689): Terminated: ok {rc=0} 22:53:29.614861 --- ParallelTerminationStrategy: PID 24692 died... 22:53:29.633839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24692): Terminated: ok {rc=0} 22:53:29.679144 --- ParallelTerminationStrategy: PID 24695 died... 22:53:29.698077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24695): Terminated: ok {rc=0} 22:53:29.783219 bus /sierra_3: Setting Powered False 22:53:30.897432 bus /sierra_3: Setting Powered False 22:53:32.025414 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 emergency:nanobts+band-900 --------------------------------------------------------------------- 22:53:33.304853 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:53:33.310666 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 22:53:33.343248 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 22:53:33.370697 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 22:53:33.455067 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 22:53:33.486620 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 22:53:33.512609 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 22:53:34.102024 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2350 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 22:53:34.107729 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:34.118683 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 22:53:34.165228 tst emergency_mo_mt_call.py: using LAC 17311 22:53:34.280478 tst emergency_mo_mt_call.py: using RAC 226 22:53:34.395826 tst emergency_mo_mt_call.py: using CellId 17311 22:53:34.512160 tst emergency_mo_mt_call.py: using BVCI 17312 22:53:34.620776 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:34.631496 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:34.641924 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:34.652611 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:34.663364 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:34.674050 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 22:53:34.791293 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 22:53:34.905312 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:53:35.367837 run create_hlr_db(pid=24701): Launched 22:53:35.481711 bus /sierra_2: Setting Powered False 22:53:36.541864 run create_hlr_db(pid=24701): Terminated: ok {rc=0} 22:53:36.979791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24703): Launched 22:53:37.298934 run osmo-hlr_10.42.42.2(pid=24704): Launched 22:53:37.420283 run osmo-stp_10.42.42.5: Starting osmo-stp 22:53:37.970452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24706): Launched 22:53:38.289495 run osmo-stp_10.42.42.5(pid=24707): Launched 22:53:38.418798 tst emergency_mo_mt_call.py: using MSISDN 6888 22:53:38.583244 run osmo-msc_10.42.42.6: Starting osmo-msc 22:53:39.158280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24709): Launched 22:53:39.477068 run osmo-msc_10.42.42.6(pid=24710): Launched 22:53:39.655537 run osmo-stp_10.42.42.5(pid=24707): ERR: Terminated: ERROR {rc=1} [trial-2350↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24707)] 22:53:39.791150 run osmo-stp_10.42.42.5(pid=24707): stdout: | (launched: 2022-12-08_22:53:38.231334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:39.926560 run osmo-stp_10.42.42.5(pid=24707): stderr: | 20221208225338422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225338422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225338423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225338423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225338423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225338424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225338424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:40.063310 run osmo-stp_10.42.42.5(pid=24707): stdout: | (launched: 2022-12-08_22:53:38.231334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:40.190668 run osmo-stp_10.42.42.5(pid=24707): stderr: | 20221208225338422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225338422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225338423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225338423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225338423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225338424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225338424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:40.343307 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=24707): Process ended prematurely: osmo-stp_10.42.42.5(pid=24707) [trial-2350↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24707)] [trial-2350↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 22:53:40.352321 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 22:53:40.380182 run osmo-hlr_10.42.42.2(pid=24704): ERR: Terminated: ERROR {rc=237} [trial-2350↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24704)] 22:53:40.431686 run osmo-hlr_10.42.42.2(pid=24704): stdout: | (launched: 2022-12-08_22:53:37.241057) 22:53:40.484890 run osmo-hlr_10.42.42.2(pid=24704): stderr: | 20221208225337437 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225337437 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225337437 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225337437 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225337437 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225337437 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225337448 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225337457 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225337457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225337457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:53:40.559133 run osmo-msc_10.42.42.6(pid=24710): ERR: Terminated: ERROR {rc=2} [trial-2350↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24710)] 22:53:40.610585 run osmo-msc_10.42.42.6(pid=24710): stdout: | (launched: 2022-12-08_22:53:39.418804) 22:53:40.663834 run osmo-msc_10.42.42.6(pid=24710): stderr: | 20221208225339739 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208225339739 DLGLOBAL DEBUG validating counter group 0x7f3e377eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208225339739 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208225339740 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208225339740 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208225339740 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208225339742 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208225339742 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208225339742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208225339742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:53:40.717207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24703): Terminating (SIGTERM) 22:53:40.759658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24706): Terminating (SIGTERM) 22:53:40.802479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24709): Terminating (SIGTERM) 22:53:40.845273 --- ParallelTerminationStrategy: PID 24703 died... 22:53:40.865663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24703): Terminated: ok {rc=0} 22:53:40.913078 --- ParallelTerminationStrategy: PID 24706 died... 22:53:40.932912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24706): Terminated: ok {rc=0} 22:53:40.980084 --- ParallelTerminationStrategy: PID 24709 died... 22:53:41.000290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24709): Terminated: ok {rc=0} 22:53:41.090046 bus /sierra_3: Setting Powered False 22:53:42.191009 bus /sierra_3: Setting Powered False 22:53:43.311063 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 22:53:44.399747 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:44.411550 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 22:53:44.461565 tst emergency_preemptive_call.py: using LAC 17312 22:53:44.587594 tst emergency_preemptive_call.py: using RAC 227 22:53:44.711885 tst emergency_preemptive_call.py: using CellId 17312 22:53:44.836555 tst emergency_preemptive_call.py: using BVCI 17313 22:53:44.951966 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:44.963255 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:44.974315 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:44.985359 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:44.996670 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:45.007808 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 22:53:45.121668 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 22:53:45.239231 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 22:53:45.354423 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 22:53:45.471350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:53:45.997632 run create_hlr_db(pid=24712): Launched 22:53:46.144763 bus /sierra_2: Setting Powered False 22:53:47.209763 run create_hlr_db(pid=24712): Terminated: ok {rc=0} 22:53:47.638131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24714): Launched 22:53:47.937847 run osmo-hlr_10.42.42.2(pid=24715): Launched 22:53:48.051389 run osmo-stp_10.42.42.5: Starting osmo-stp 22:53:48.577633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24717): Launched 22:53:48.878353 run osmo-stp_10.42.42.5(pid=24718): Launched 22:53:49.001726 tst emergency_preemptive_call.py: using MSISDN 6889 22:53:49.154825 run osmo-msc_10.42.42.6: Starting osmo-msc 22:53:49.692618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24720): Launched 22:53:49.991426 run osmo-msc_10.42.42.6(pid=24721): Launched 22:53:50.158965 run osmo-stp_10.42.42.5(pid=24718): ERR: Terminated: ERROR {rc=1} [trial-2350↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24718)] 22:53:50.287300 run osmo-stp_10.42.42.5(pid=24718): stdout: | (launched: 2022-12-08_22:53:48.822869) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:50.415541 run osmo-stp_10.42.42.5(pid=24718): stderr: | 20221208225348993 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225348993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225348994 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225348994 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225348995 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225348995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225348995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:50.541130 run osmo-stp_10.42.42.5(pid=24718): stdout: | (launched: 2022-12-08_22:53:48.822869) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:50.660627 run osmo-stp_10.42.42.5(pid=24718): stderr: | 20221208225348993 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225348993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225348994 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225348994 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225348995 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225348995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225348995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:50.803432 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=24718): Process ended prematurely: osmo-stp_10.42.42.5(pid=24718) [trial-2350↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24718)] [trial-2350↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 22:53:50.811883 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 22:53:50.839264 run osmo-hlr_10.42.42.2(pid=24715): ERR: Terminated: ERROR {rc=237} [trial-2350↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24715)] 22:53:50.889095 run osmo-hlr_10.42.42.2(pid=24715): stdout: | (launched: 2022-12-08_22:53:47.882823) 22:53:50.940016 run osmo-hlr_10.42.42.2(pid=24715): stderr: | 20221208225348059 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225348059 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225348059 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225348059 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225348059 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225348059 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225348072 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225348082 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225348083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225348083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:53:51.011565 run osmo-msc_10.42.42.6(pid=24721): ERR: Terminated: ERROR {rc=2} [trial-2350↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24721)] 22:53:51.061121 run osmo-msc_10.42.42.6(pid=24721): stdout: | (launched: 2022-12-08_22:53:49.936558) 22:53:51.111994 run osmo-msc_10.42.42.6(pid=24721): stderr: | 20221208225350209 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208225350209 DLGLOBAL DEBUG validating counter group 0x7f8d9b945c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208225350209 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208225350209 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208225350209 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208225350210 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208225350211 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208225350212 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208225350212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208225350212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:53:51.163062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24714): Terminating (SIGTERM) 22:53:51.204203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24717): Terminating (SIGTERM) 22:53:51.245986 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24720): Terminating (SIGTERM) 22:53:51.287470 --- ParallelTerminationStrategy: PID 24714 died... 22:53:51.307025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24714): Terminated: ok {rc=0} 22:53:51.352803 --- ParallelTerminationStrategy: PID 24717 died... 22:53:51.372440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24717): Terminated: ok {rc=0} 22:53:51.418372 --- ParallelTerminationStrategy: PID 24720 died... 22:53:51.437480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24720): Terminated: ok {rc=0} 22:53:51.523514 bus /sierra_9: Setting Powered False 22:53:52.623338 bus /sierra_9: Setting Powered False 22:53:53.742406 bus /sierra_8: Setting Powered False 22:53:54.842735 bus /sierra_8: Setting Powered False 22:53:55.962088 bus /sierra_3: Setting Powered False 22:53:57.062595 bus /sierra_3: Setting Powered False 22:53:58.181667 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:nanobts+band-900 --------------------------------------------------------------------- 22:53:59.455192 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:53:59.460584 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 22:53:59.492745 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 22:53:59.530731 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 22:53:59.615820 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 22:53:59.647895 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 22:53:59.685854 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 22:54:00.275672 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 22:54:00.325649 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:00.336207 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 22:54:00.387416 tst cs_paging_gprs_active.py: using LAC 17313 22:54:00.509746 tst cs_paging_gprs_active.py: using RAC 228 22:54:00.658053 tst cs_paging_gprs_active.py: using CellId 17313 22:54:00.789398 tst cs_paging_gprs_active.py: using BVCI 17314 22:54:00.945784 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:00.957095 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:00.968888 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:00.980377 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:00.991852 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:01.003407 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:01.015612 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:01.027865 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:01.040009 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:54:01.165827 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:54:01.311037 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:54:01.525065 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:01.848847 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24726): Launched 22:54:02.141042 run iperf3-srv_10.42.42.10(pid=24727): Launched 22:54:02.274261 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:54:02.478961 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:02.785439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24728): Launched 22:54:03.051939 run iperf3-srv_10.42.42.10(pid=24729): Launched 22:54:03.166500 tst cs_paging_gprs_active.py:38: start network... 22:54:03.370573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:54:03.844770 run create_hlr_db(pid=24730): Launched 22:54:03.972901 bus /sierra_2: Setting Powered False 22:54:05.033692 run create_hlr_db(pid=24730): Terminated: ok {rc=0} 22:54:05.457807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24732): Launched 22:54:05.762873 run osmo-hlr_10.42.42.2(pid=24733): Launched 22:54:05.878357 run osmo-stp_10.42.42.5: Starting osmo-stp 22:54:06.405153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24735): Launched 22:54:06.709717 run osmo-stp_10.42.42.5(pid=24736): Launched 22:54:06.826203 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:54:07.350840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24738): Launched 22:54:07.467131 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:54:07.727138 run patchelf(pid=24739): Launched 22:54:07.898757 run osmo-stp_10.42.42.5(pid=24736): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24736)] 22:54:08.027710 run osmo-stp_10.42.42.5(pid=24736): stdout: | (launched: 2022-12-08_22:54:06.654097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:08.158492 run osmo-stp_10.42.42.5(pid=24736): stderr: | 20221208225406825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225406825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225406826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225406826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225406826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225406827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225406827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:08.289297 run osmo-stp_10.42.42.5(pid=24736): stdout: | (launched: 2022-12-08_22:54:06.654097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:08.414767 run osmo-stp_10.42.42.5(pid=24736): stderr: | 20221208225406825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225406825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225406826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225406826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225406826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225406827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225406827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:08.563347 run patchelf(pid=24739): Terminating (SIGINT) 22:54:08.734805 run patchelf(pid=24739): Terminated: ok {rc=0} 22:54:08.858506 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24736): Process ended prematurely: osmo-stp_10.42.42.5(pid=24736) [trial-2350↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24736)] [trial-2350↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 22:54:08.867977 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 22:54:08.896044 run osmo-hlr_10.42.42.2(pid=24733): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24733)] 22:54:08.944292 run osmo-hlr_10.42.42.2(pid=24733): stdout: | (launched: 2022-12-08_22:54:05.707232) 22:54:08.994590 run osmo-hlr_10.42.42.2(pid=24733): stderr: | 20221208225405886 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225405886 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225405886 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225405886 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225405886 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225405886 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225405898 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225405908 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225405908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225405908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:54:09.045367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24726): Terminating (SIGTERM) 22:54:09.085588 run iperf3-srv_10.42.42.10(pid=24727): Terminating (SIGTERM) 22:54:09.125820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24728): Terminating (SIGTERM) 22:54:09.166300 run iperf3-srv_10.42.42.10(pid=24729): Terminating (SIGTERM) 22:54:09.206526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24732): Terminating (SIGTERM) 22:54:09.247097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24735): Terminating (SIGTERM) 22:54:09.287446 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24738): Terminating (SIGTERM) 22:54:09.328203 --- ParallelTerminationStrategy: PID 24726 died... 22:54:09.347487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24726): Terminated: ok {rc=0} 22:54:09.392696 --- ParallelTerminationStrategy: PID 24727 died... 22:54:09.411564 run iperf3-srv_10.42.42.10(pid=24727): Terminated {rc=256} 22:54:09.456240 --- ParallelTerminationStrategy: PID 24728 died... 22:54:09.474975 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24728): Terminated: ok {rc=0} 22:54:09.519775 --- ParallelTerminationStrategy: PID 24729 died... 22:54:09.538558 run iperf3-srv_10.42.42.10(pid=24729): Terminated {rc=256} 22:54:09.583242 --- ParallelTerminationStrategy: PID 24732 died... 22:54:09.602076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24732): Terminated: ok {rc=0} 22:54:09.646968 --- ParallelTerminationStrategy: PID 24735 died... 22:54:09.665785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24735): Terminated: ok {rc=0} 22:54:09.711298 --- ParallelTerminationStrategy: PID 24738 died... 22:54:09.730267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24738): Terminated: ok {rc=0} 22:54:09.818129 bus /gobi_0: Setting Powered False 22:54:10.918420 bus /gobi_0: Setting Powered False 22:54:12.035924 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 22:54:13.184073 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:13.195324 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 22:54:13.245651 tst iperf3.py: using LAC 17314 22:54:13.365650 tst iperf3.py: using RAC 229 22:54:13.496650 tst iperf3.py: using CellId 17314 22:54:13.625366 tst iperf3.py: using BVCI 17315 22:54:13.745349 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:13.756863 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:13.768215 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:13.780057 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:13.791796 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:13.803507 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:13.815472 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:13.827253 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:13.839201 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:54:13.956371 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:54:14.161070 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:14.466539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24740): Launched 22:54:14.731564 run iperf3-srv_10.42.42.10(pid=24741): Launched 22:54:14.846240 tst iperf3.py:8: start network... 22:54:15.050628 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:54:15.523088 run create_hlr_db(pid=24742): Launched 22:54:15.640194 bus /gobi_6: Setting Powered False 22:54:16.722931 run create_hlr_db(pid=24742): Terminated: ok {rc=0} 22:54:17.172210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24744): Launched 22:54:17.490852 run osmo-hlr_10.42.42.2(pid=24745): Launched 22:54:17.609435 run osmo-stp_10.42.42.5: Starting osmo-stp 22:54:18.150389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24747): Launched 22:54:18.454423 run osmo-stp_10.42.42.5(pid=24748): Launched 22:54:18.570885 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:54:19.097111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24750): Launched 22:54:19.213948 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:54:19.472023 run patchelf(pid=24751): Launched 22:54:19.642212 run osmo-stp_10.42.42.5(pid=24748): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24748)] 22:54:19.772323 run osmo-stp_10.42.42.5(pid=24748): stdout: | (launched: 2022-12-08_22:54:18.398967) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:19.904206 run osmo-stp_10.42.42.5(pid=24748): stderr: | 20221208225418569 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225418569 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225418570 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225418570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225418570 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225418571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225418571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:20.036093 run osmo-stp_10.42.42.5(pid=24748): stdout: | (launched: 2022-12-08_22:54:18.398967) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:20.162317 run osmo-stp_10.42.42.5(pid=24748): stderr: | 20221208225418569 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225418569 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225418570 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225418570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225418570 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225418571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225418571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:20.311634 run patchelf(pid=24751): Terminating (SIGINT) 22:54:20.483402 run patchelf(pid=24751): Terminated: ok {rc=0} 22:54:20.607276 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24748): Process ended prematurely: osmo-stp_10.42.42.5(pid=24748) [trial-2350↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24748)] [trial-2350↪gprs:nanobts+band-900↪iperf3.py:8] 22:54:20.616705 tst iperf3.py:8: Test FAILED (7.5 sec) 22:54:20.644906 run osmo-hlr_10.42.42.2(pid=24745): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24745)] 22:54:20.694120 run osmo-hlr_10.42.42.2(pid=24745): stdout: | (launched: 2022-12-08_22:54:17.434869) 22:54:20.744629 run osmo-hlr_10.42.42.2(pid=24745): stderr: | 20221208225417612 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225417612 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225417612 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225417612 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225417612 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225417612 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225417624 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225417633 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225417633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225417633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:54:20.795793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24740): Terminating (SIGTERM) 22:54:20.836830 run iperf3-srv_10.42.42.10(pid=24741): Terminating (SIGTERM) 22:54:20.877795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24744): Terminating (SIGTERM) 22:54:20.918529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24747): Terminating (SIGTERM) 22:54:20.959436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24750): Terminating (SIGTERM) 22:54:21.000696 --- ParallelTerminationStrategy: PID 24740 died... 22:54:21.020193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24740): Terminated: ok {rc=0} 22:54:21.066254 --- ParallelTerminationStrategy: PID 24741 died... 22:54:21.085381 run iperf3-srv_10.42.42.10(pid=24741): Terminated {rc=256} 22:54:21.130700 --- ParallelTerminationStrategy: PID 24744 died... 22:54:21.149624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24744): Terminated: ok {rc=0} 22:54:21.195218 --- ParallelTerminationStrategy: PID 24747 died... 22:54:21.214384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24747): Terminated: ok {rc=0} 22:54:21.260050 --- ParallelTerminationStrategy: PID 24750 died... 22:54:21.279251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24750): Terminated: ok {rc=0} 22:54:21.366327 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 22:54:22.515881 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:22.527189 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 22:54:22.575071 tst iperf3m4.py: using LAC 17315 22:54:22.697135 tst iperf3m4.py: using RAC 230 22:54:22.817108 tst iperf3m4.py: using CellId 17315 22:54:22.938374 tst iperf3m4.py: using BVCI 17316 22:54:23.051305 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:23.062393 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:23.073149 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:23.083877 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:23.094688 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:23.105645 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:23.116671 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:23.127452 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:23.138264 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:54:23.257654 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:54:23.375404 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:54:23.495402 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:54:23.611490 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:54:23.815731 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:24.122660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24752): Launched 22:54:24.387807 run iperf3-srv_10.42.42.10(pid=24753): Launched 22:54:24.502418 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:54:24.706094 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:25.013018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24754): Launched 22:54:25.278010 run iperf3-srv_10.42.42.10(pid=24755): Launched 22:54:25.392601 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:54:25.596574 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:25.903430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24756): Launched 22:54:26.168938 run iperf3-srv_10.42.42.10(pid=24757): Launched 22:54:26.283303 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:54:26.487247 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:26.792931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24758): Launched 22:54:27.058320 run iperf3-srv_10.42.42.10(pid=24759): Launched 22:54:27.172814 tst iperf3m4.py:8: start network... 22:54:27.376216 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:54:27.849603 run create_hlr_db(pid=24760): Launched 22:54:27.966713 bus /gobi_6: Setting Powered False 22:54:29.027718 run create_hlr_db(pid=24760): Terminated: ok {rc=0} 22:54:29.473722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24762): Launched 22:54:29.800561 run osmo-hlr_10.42.42.2(pid=24763): Launched 22:54:29.925426 run osmo-stp_10.42.42.5: Starting osmo-stp 22:54:30.493231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24765): Launched 22:54:30.818822 run osmo-stp_10.42.42.5(pid=24766): Launched 22:54:31.116446 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:54:31.723164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24768): Launched 22:54:31.854395 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:54:32.122000 run patchelf(pid=24769): Launched 22:54:32.311231 run osmo-stp_10.42.42.5(pid=24766): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24766)] 22:54:32.443163 run osmo-stp_10.42.42.5(pid=24766): stdout: | (launched: 2022-12-08_22:54:30.759358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:32.575469 run osmo-stp_10.42.42.5(pid=24766): stderr: | 20221208225430984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225430984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225430984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225430985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225430985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225430985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225430985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:32.707880 run osmo-stp_10.42.42.5(pid=24766): stdout: | (launched: 2022-12-08_22:54:30.759358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:32.834530 run osmo-stp_10.42.42.5(pid=24766): stderr: | 20221208225430984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225430984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225430984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225430985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225430985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225430985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225430985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:32.983849 run patchelf(pid=24769): Terminating (SIGINT) 22:54:33.157516 run patchelf(pid=24769): Terminated: ok {rc=0} 22:54:33.282066 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24766): Process ended prematurely: osmo-stp_10.42.42.5(pid=24766) [trial-2350↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24766)] [trial-2350↪gprs:nanobts+band-900↪iperf3m4.py:8] 22:54:33.291788 tst iperf3m4.py:8: Test FAILED (10.8 sec) 22:54:33.320605 run osmo-hlr_10.42.42.2(pid=24763): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24763)] 22:54:33.370103 run osmo-hlr_10.42.42.2(pid=24763): stdout: | (launched: 2022-12-08_22:54:29.741339) 22:54:33.421453 run osmo-hlr_10.42.42.2(pid=24763): stderr: | 20221208225429943 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225429943 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225429943 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225429943 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225429943 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225429944 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225429957 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225429967 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225429967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225429967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:54:33.473290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24752): Terminating (SIGTERM) 22:54:33.514293 run iperf3-srv_10.42.42.10(pid=24753): Terminating (SIGTERM) 22:54:33.555396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24754): Terminating (SIGTERM) 22:54:33.596433 run iperf3-srv_10.42.42.10(pid=24755): Terminating (SIGTERM) 22:54:33.637407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24756): Terminating (SIGTERM) 22:54:33.678575 run iperf3-srv_10.42.42.10(pid=24757): Terminating (SIGTERM) 22:54:33.719599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24758): Terminating (SIGTERM) 22:54:33.760702 run iperf3-srv_10.42.42.10(pid=24759): Terminating (SIGTERM) 22:54:33.801885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24762): Terminating (SIGTERM) 22:54:33.843015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24765): Terminating (SIGTERM) 22:54:33.884052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24768): Terminating (SIGTERM) 22:54:33.925820 --- ParallelTerminationStrategy: PID 24752 died... 22:54:33.945301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24752): Terminated: ok {rc=0} 22:54:33.991650 --- ParallelTerminationStrategy: PID 24753 died... 22:54:34.011017 run iperf3-srv_10.42.42.10(pid=24753): Terminated {rc=256} 22:54:34.056813 --- ParallelTerminationStrategy: PID 24754 died... 22:54:34.076428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24754): Terminated: ok {rc=0} 22:54:34.122462 --- ParallelTerminationStrategy: PID 24755 died... 22:54:34.141686 run iperf3-srv_10.42.42.10(pid=24755): Terminated {rc=256} 22:54:34.187552 --- ParallelTerminationStrategy: PID 24756 died... 22:54:34.206920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24756): Terminated: ok {rc=0} 22:54:34.253334 --- ParallelTerminationStrategy: PID 24757 died... 22:54:34.272598 run iperf3-srv_10.42.42.10(pid=24757): Terminated {rc=256} 22:54:34.318406 --- ParallelTerminationStrategy: PID 24758 died... 22:54:34.337662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24758): Terminated: ok {rc=0} 22:54:34.383620 --- ParallelTerminationStrategy: PID 24759 died... 22:54:34.402898 run iperf3-srv_10.42.42.10(pid=24759): Terminated {rc=256} 22:54:34.448654 --- ParallelTerminationStrategy: PID 24762 died... 22:54:34.468057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24762): Terminated: ok {rc=0} 22:54:34.513998 --- ParallelTerminationStrategy: PID 24765 died... 22:54:34.533477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24765): Terminated: ok {rc=0} 22:54:34.579400 --- ParallelTerminationStrategy: PID 24768 died... 22:54:34.598821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24768): Terminated: ok {rc=0} 22:54:34.686148 bus /gobi_4: Setting Powered False 22:54:35.786375 bus /gobi_4: Setting Powered False 22:54:36.906907 bus /gobi_1: Setting Powered False 22:54:38.007933 bus /gobi_1: Setting Powered False 22:54:39.126108 bus /gobi_0: Setting Powered False 22:54:40.224465 bus /gobi_0: Setting Powered False 22:54:41.342429 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-900 ping.py ---------------------------------------------- 22:54:42.446618 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:42.458275 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 22:54:42.506958 tst ping.py: using LAC 17316 22:54:42.634291 tst ping.py: using RAC 231 22:54:42.761080 tst ping.py: using CellId 17316 22:54:42.886802 tst ping.py: using BVCI 17317 22:54:43.004562 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:43.015806 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:43.027186 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:43.038266 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:43.049202 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:43.060090 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:43.071219 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:43.082422 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:54:43.198862 tst ping.py:19: start network... 22:54:43.413771 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:54:43.906102 run create_hlr_db(pid=24770): Launched 22:54:44.035764 bus /gobi_6: Setting Powered False 22:54:45.100067 run create_hlr_db(pid=24770): Terminated: ok {rc=0} 22:54:45.527741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24772): Launched 22:54:45.826646 run osmo-hlr_10.42.42.2(pid=24773): Launched 22:54:45.977369 run osmo-stp_10.42.42.5: Starting osmo-stp 22:54:46.725765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24775): Launched 22:54:47.040272 run osmo-stp_10.42.42.5(pid=24776): Launched 22:54:47.275294 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:54:47.871814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24778): Launched 22:54:47.993525 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:54:48.264233 run patchelf(pid=24779): Launched 22:54:48.442336 run osmo-stp_10.42.42.5(pid=24776): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24776)] 22:54:48.578359 run osmo-stp_10.42.42.5(pid=24776): stdout: | (launched: 2022-12-08_22:54:46.978363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:48.715865 run osmo-stp_10.42.42.5(pid=24776): stderr: | 20221208225447297 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225447297 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225447297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225447298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225447300 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225447300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225447300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:48.853180 run osmo-stp_10.42.42.5(pid=24776): stdout: | (launched: 2022-12-08_22:54:46.978363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:48.984403 run osmo-stp_10.42.42.5(pid=24776): stderr: | 20221208225447297 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225447297 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225447297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225447298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225447300 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225447300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225447300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:49.140599 run patchelf(pid=24779): Terminating (SIGINT) 22:54:49.320454 run patchelf(pid=24779): Terminated: ok {rc=0} 22:54:49.450007 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24776): Process ended prematurely: osmo-stp_10.42.42.5(pid=24776) [trial-2350↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24776)] [trial-2350↪gprs:nanobts+band-900↪ping.py:22] 22:54:49.459540 tst ping.py:22: Test FAILED (7.0 sec) 22:54:49.488196 run osmo-hlr_10.42.42.2(pid=24773): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24773)] 22:54:49.539003 run osmo-hlr_10.42.42.2(pid=24773): stdout: | (launched: 2022-12-08_22:54:45.771804) 22:54:49.591521 run osmo-hlr_10.42.42.2(pid=24773): stderr: | 20221208225446142 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225446142 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225446142 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225446142 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225446142 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225446143 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225446164 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225446178 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225446179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225446179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:54:49.644612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24772): Terminating (SIGTERM) 22:54:49.686889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24775): Terminating (SIGTERM) 22:54:49.729395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24778): Terminating (SIGTERM) 22:54:49.772033 --- ParallelTerminationStrategy: PID 24772 died... 22:54:49.792468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24772): Terminated: ok {rc=0} 22:54:49.839473 --- ParallelTerminationStrategy: PID 24775 died... 22:54:49.859432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24775): Terminated: ok {rc=0} 22:54:49.906570 --- ParallelTerminationStrategy: PID 24778 died... 22:54:49.926310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24778): Terminated: ok {rc=0} 22:54:50.013875 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 22:54:51.102167 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:51.114014 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 22:54:51.166715 tst ping_idle_ping.py: using LAC 17317 22:54:51.295256 tst ping_idle_ping.py: using RAC 232 22:54:51.414912 tst ping_idle_ping.py: using CellId 17317 22:54:51.534162 tst ping_idle_ping.py: using BVCI 17318 22:54:51.645575 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:51.656193 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:51.666815 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:51.677824 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:51.688339 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:51.698966 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:51.709715 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:51.720440 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:54:51.839850 tst ping_idle_ping.py:24: start network... 22:54:52.056857 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:54:52.557027 run create_hlr_db(pid=24780): Launched 22:54:52.687863 bus /gobi_6: Setting Powered False 22:54:53.752939 run create_hlr_db(pid=24780): Terminated: ok {rc=0} 22:54:54.184143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24782): Launched 22:54:54.486914 run osmo-hlr_10.42.42.2(pid=24783): Launched 22:54:54.602176 run osmo-stp_10.42.42.5: Starting osmo-stp 22:54:55.137995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24785): Launched 22:54:55.438733 run osmo-stp_10.42.42.5(pid=24786): Launched 22:54:55.553626 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:54:56.072475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24788): Launched 22:54:56.196740 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:54:56.467775 run patchelf(pid=24789): Launched 22:54:56.647180 run osmo-stp_10.42.42.5(pid=24786): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24786)] 22:54:56.784228 run osmo-stp_10.42.42.5(pid=24786): stdout: | (launched: 2022-12-08_22:54:55.383469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:56.922469 run osmo-stp_10.42.42.5(pid=24786): stderr: | 20221208225455551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225455552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225455552 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225455552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225455554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225455555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225455555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:57.061375 run osmo-stp_10.42.42.5(pid=24786): stdout: | (launched: 2022-12-08_22:54:55.383469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:57.193956 run osmo-stp_10.42.42.5(pid=24786): stderr: | 20221208225455551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225455552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225455552 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225455552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225455554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225455555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225455555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:57.351099 run patchelf(pid=24789): Terminating (SIGINT) 22:54:57.533392 run patchelf(pid=24789): Terminated: ok {rc=0} 22:54:57.663844 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24786): Process ended prematurely: osmo-stp_10.42.42.5(pid=24786) [trial-2350↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24786)] [trial-2350↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 22:54:57.673265 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:54:57.701854 run osmo-hlr_10.42.42.2(pid=24783): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24783)] 22:54:57.752835 run osmo-hlr_10.42.42.2(pid=24783): stdout: | (launched: 2022-12-08_22:54:54.431246) 22:54:57.806013 run osmo-hlr_10.42.42.2(pid=24783): stderr: | 20221208225454607 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225454607 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225454607 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225454607 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225454607 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225454607 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225454619 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225454628 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225454628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225454628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:54:57.859437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24782): Terminating (SIGTERM) 22:54:57.902300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24785): Terminating (SIGTERM) 22:54:57.945124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24788): Terminating (SIGTERM) 22:54:57.988213 --- ParallelTerminationStrategy: PID 24782 died... 22:54:58.008670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24782): Terminated: ok {rc=0} 22:54:58.056498 --- ParallelTerminationStrategy: PID 24785 died... 22:54:58.076615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24785): Terminated: ok {rc=0} 22:54:58.124460 --- ParallelTerminationStrategy: PID 24788 died... 22:54:58.144829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24788): Terminated: ok {rc=0} 22:54:58.234342 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 22:54:59.541683 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:54:59.548173 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:54:59.581983 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:54:59.621565 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:54:59.708021 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:54:59.740938 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:54:59.780407 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:55:00.382090 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:55:00.435213 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:00.446557 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:55:00.495857 tst cs_paging_gprs_active.py: using LAC 17318 22:55:00.623143 tst cs_paging_gprs_active.py: using RAC 233 22:55:00.749595 tst cs_paging_gprs_active.py: using CellId 17318 22:55:00.885471 tst cs_paging_gprs_active.py: using BVCI 17319 22:55:01.007213 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:01.019293 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:01.031467 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:01.045239 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:01.056874 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:01.069846 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:01.083909 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:01.096674 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:01.108778 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:01.232648 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:01.379224 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:55:01.622917 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:02.018255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24797): Launched 22:55:02.326683 run iperf3-srv_10.42.42.10(pid=24798): Launched 22:55:02.449419 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:55:02.668874 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:02.995870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24799): Launched 22:55:03.279678 run iperf3-srv_10.42.42.10(pid=24800): Launched 22:55:03.402049 tst cs_paging_gprs_active.py:38: start network... 22:55:03.621675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:55:04.128743 run create_hlr_db(pid=24801): Launched 22:55:04.261636 bus /gobi_6: Setting Powered False 22:55:05.325569 run create_hlr_db(pid=24801): Terminated: ok {rc=0} 22:55:05.779213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24803): Launched 22:55:06.086088 run osmo-hlr_10.42.42.2(pid=24804): Launched 22:55:06.202555 run osmo-stp_10.42.42.5: Starting osmo-stp 22:55:06.744853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24806): Launched 22:55:07.051786 run osmo-stp_10.42.42.5(pid=24807): Launched 22:55:07.168482 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:55:07.697049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24809): Launched 22:55:07.814184 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:55:08.072629 run patchelf(pid=24810): Launched 22:55:08.243763 run osmo-stp_10.42.42.5(pid=24807): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24807)] 22:55:08.373622 run osmo-stp_10.42.42.5(pid=24807): stdout: | (launched: 2022-12-08_22:55:06.995605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:08.505137 run osmo-stp_10.42.42.5(pid=24807): stderr: | 20221208225507166 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225507166 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225507167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225507167 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225507167 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225507168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225507168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:08.636561 run osmo-stp_10.42.42.5(pid=24807): stdout: | (launched: 2022-12-08_22:55:06.995605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:08.762705 run osmo-stp_10.42.42.5(pid=24807): stderr: | 20221208225507166 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225507166 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225507167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225507167 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225507167 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225507168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225507168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:08.912530 run patchelf(pid=24810): Terminating (SIGINT) 22:55:09.084292 run patchelf(pid=24810): Terminated: ok {rc=0} 22:55:09.208069 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24807): Process ended prematurely: osmo-stp_10.42.42.5(pid=24807) [trial-2350↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24807)] [trial-2350↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:55:09.217623 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 22:55:09.245682 run osmo-hlr_10.42.42.2(pid=24804): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24804)] 22:55:09.294446 run osmo-hlr_10.42.42.2(pid=24804): stdout: | (launched: 2022-12-08_22:55:06.030365) 22:55:09.345158 run osmo-hlr_10.42.42.2(pid=24804): stderr: | 20221208225506207 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225506207 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225506207 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225506207 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225506207 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225506207 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225506219 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225506228 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225506228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225506228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:55:09.395961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24797): Terminating (SIGTERM) 22:55:09.436615 run iperf3-srv_10.42.42.10(pid=24798): Terminating (SIGTERM) 22:55:09.477261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24799): Terminating (SIGTERM) 22:55:09.517936 run iperf3-srv_10.42.42.10(pid=24800): Terminating (SIGTERM) 22:55:09.558490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24803): Terminating (SIGTERM) 22:55:09.599037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24806): Terminating (SIGTERM) 22:55:09.639665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24809): Terminating (SIGTERM) 22:55:09.680487 --- ParallelTerminationStrategy: PID 24797 died... 22:55:09.699897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24797): Terminated: ok {rc=0} 22:55:09.745710 --- ParallelTerminationStrategy: PID 24798 died... 22:55:09.764595 run iperf3-srv_10.42.42.10(pid=24798): Terminated {rc=256} 22:55:09.809627 --- ParallelTerminationStrategy: PID 24799 died... 22:55:09.828418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24799): Terminated: ok {rc=0} 22:55:09.873692 --- ParallelTerminationStrategy: PID 24800 died... 22:55:09.892554 run iperf3-srv_10.42.42.10(pid=24800): Terminated {rc=256} 22:55:09.937623 --- ParallelTerminationStrategy: PID 24803 died... 22:55:09.956532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24803): Terminated: ok {rc=0} 22:55:10.001536 --- ParallelTerminationStrategy: PID 24806 died... 22:55:10.020426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24806): Terminated: ok {rc=0} 22:55:10.065561 --- ParallelTerminationStrategy: PID 24809 died... 22:55:10.084508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24809): Terminated: ok {rc=0} 22:55:10.169796 bus /gobi_0: Setting Powered False 22:55:11.266075 bus /gobi_0: Setting Powered False 22:55:12.378861 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:55:13.529069 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:13.540914 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:55:13.593439 tst iperf3.py: using LAC 17319 22:55:13.714422 tst iperf3.py: using RAC 234 22:55:13.837061 tst iperf3.py: using CellId 17319 22:55:13.959361 tst iperf3.py: using BVCI 17320 22:55:14.073164 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:14.084146 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:14.095079 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:14.106813 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:14.118387 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:14.129691 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:14.141282 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:14.152611 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:14.164092 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:14.287618 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:55:14.508516 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:14.836055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24811): Launched 22:55:15.120719 run iperf3-srv_10.42.42.10(pid=24812): Launched 22:55:15.243435 tst iperf3.py:8: start network... 22:55:15.464279 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:55:15.983429 run create_hlr_db(pid=24813): Launched 22:55:16.150302 bus /gobi_6: Setting Powered False 22:55:17.213556 run create_hlr_db(pid=24813): Terminated: ok {rc=0} 22:55:17.645802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24815): Launched 22:55:17.952827 run osmo-hlr_10.42.42.2(pid=24816): Launched 22:55:18.069138 run osmo-stp_10.42.42.5: Starting osmo-stp 22:55:18.600724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24818): Launched 22:55:18.927890 run osmo-stp_10.42.42.5(pid=24819): Launched 22:55:19.051837 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:55:19.613705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24821): Launched 22:55:19.738867 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:55:20.015656 run patchelf(pid=24822): Launched 22:55:20.197494 run osmo-stp_10.42.42.5(pid=24819): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24819)] 22:55:20.335963 run osmo-stp_10.42.42.5(pid=24819): stdout: | (launched: 2022-12-08_22:55:18.868853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:20.475620 run osmo-stp_10.42.42.5(pid=24819): stderr: | 20221208225519061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225519061 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225519061 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225519062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225519062 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225519062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225519062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:20.615293 run osmo-stp_10.42.42.5(pid=24819): stdout: | (launched: 2022-12-08_22:55:18.868853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:20.749482 run osmo-stp_10.42.42.5(pid=24819): stderr: | 20221208225519061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225519061 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225519061 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225519062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225519062 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225519062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225519062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:20.908212 run patchelf(pid=24822): Terminating (SIGINT) 22:55:21.091407 run patchelf(pid=24822): Terminated: ok {rc=0} 22:55:21.222904 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24819): Process ended prematurely: osmo-stp_10.42.42.5(pid=24819) [trial-2350↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24819)] [trial-2350↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 22:55:21.233182 tst iperf3.py:8: Test FAILED (7.7 sec) 22:55:21.262228 run osmo-hlr_10.42.42.2(pid=24816): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24816)] 22:55:21.313267 run osmo-hlr_10.42.42.2(pid=24816): stdout: | (launched: 2022-12-08_22:55:17.896786) 22:55:21.365972 run osmo-hlr_10.42.42.2(pid=24816): stderr: | 20221208225518072 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225518072 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225518072 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225518073 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225518073 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225518073 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225518084 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225518094 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225518094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225518094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:55:21.419027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24811): Terminating (SIGTERM) 22:55:21.461612 run iperf3-srv_10.42.42.10(pid=24812): Terminating (SIGTERM) 22:55:21.503993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24815): Terminating (SIGTERM) 22:55:21.546567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24818): Terminating (SIGTERM) 22:55:21.589027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24821): Terminating (SIGTERM) 22:55:21.631706 --- ParallelTerminationStrategy: PID 24811 died... 22:55:21.652017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24811): Terminated: ok {rc=0} 22:55:21.699070 --- ParallelTerminationStrategy: PID 24812 died... 22:55:21.718894 run iperf3-srv_10.42.42.10(pid=24812): Terminated {rc=256} 22:55:21.766324 --- ParallelTerminationStrategy: PID 24815 died... 22:55:21.786369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24815): Terminated: ok {rc=0} 22:55:21.833430 --- ParallelTerminationStrategy: PID 24818 died... 22:55:21.853306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24818): Terminated: ok {rc=0} 22:55:21.900359 --- ParallelTerminationStrategy: PID 24821 died... 22:55:21.920226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24821): Terminated: ok {rc=0} 22:55:22.009727 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:55:23.159848 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:23.171355 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:55:23.219495 tst iperf3m4.py: using LAC 17320 22:55:23.341386 tst iperf3m4.py: using RAC 235 22:55:23.461402 tst iperf3m4.py: using CellId 17320 22:55:23.583424 tst iperf3m4.py: using BVCI 17321 22:55:23.697080 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:23.707947 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:23.718739 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:23.729759 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:23.740214 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:23.750934 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:23.762192 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:23.773209 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:23.784151 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:23.901881 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:24.019036 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:24.134810 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:24.254404 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:55:24.474883 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:24.801716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24823): Launched 22:55:25.086389 run iperf3-srv_10.42.42.10(pid=24824): Launched 22:55:25.209738 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:55:25.429147 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:25.756195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24825): Launched 22:55:26.040042 run iperf3-srv_10.42.42.10(pid=24826): Launched 22:55:26.163244 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:55:26.382908 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:26.710381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24827): Launched 22:55:26.994247 run iperf3-srv_10.42.42.10(pid=24828): Launched 22:55:27.117436 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:55:27.336913 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:27.664526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24829): Launched 22:55:27.947477 run iperf3-srv_10.42.42.10(pid=24830): Launched 22:55:28.069747 tst iperf3m4.py:8: start network... 22:55:28.289150 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:55:28.796055 run create_hlr_db(pid=24831): Launched 22:55:28.927048 bus /gobi_6: Setting Powered False 22:55:29.991927 run create_hlr_db(pid=24831): Terminated: ok {rc=0} 22:55:30.428921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24833): Launched 22:55:30.735006 run osmo-hlr_10.42.42.2(pid=24834): Launched 22:55:30.852116 run osmo-stp_10.42.42.5: Starting osmo-stp 22:55:31.603557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24836): Launched 22:55:31.959856 run osmo-stp_10.42.42.5(pid=24837): Launched 22:55:32.110391 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:55:32.759906 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24839): Launched 22:55:32.877569 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:55:33.135955 run patchelf(pid=24840): Launched 22:55:33.306564 run osmo-stp_10.42.42.5(pid=24837): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24837)] 22:55:33.436547 run osmo-stp_10.42.42.5(pid=24837): stdout: | (launched: 2022-12-08_22:55:31.886725) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:33.568108 run osmo-stp_10.42.42.5(pid=24837): stderr: | 20221208225532239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225532240 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225532240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225532240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225532241 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225532241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225532241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:33.699906 run osmo-stp_10.42.42.5(pid=24837): stdout: | (launched: 2022-12-08_22:55:31.886725) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:33.826205 run osmo-stp_10.42.42.5(pid=24837): stderr: | 20221208225532239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225532240 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225532240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225532240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225532241 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225532241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225532241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:33.975760 run patchelf(pid=24840): Terminating (SIGINT) 22:55:34.147944 run patchelf(pid=24840): Terminated: ok {rc=0} 22:55:34.271832 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24837): Process ended prematurely: osmo-stp_10.42.42.5(pid=24837) [trial-2350↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24837)] [trial-2350↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 22:55:34.281516 tst iperf3m4.py:8: Test FAILED (11.2 sec) 22:55:34.309997 run osmo-hlr_10.42.42.2(pid=24834): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24834)] 22:55:34.358576 run osmo-hlr_10.42.42.2(pid=24834): stdout: | (launched: 2022-12-08_22:55:30.678705) 22:55:34.409157 run osmo-hlr_10.42.42.2(pid=24834): stderr: | 20221208225530911 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225530911 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225530911 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225530911 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225530911 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225530911 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225530924 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225530943 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225530943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225530943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:55:34.460027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24823): Terminating (SIGTERM) 22:55:34.500390 run iperf3-srv_10.42.42.10(pid=24824): Terminating (SIGTERM) 22:55:34.540577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24825): Terminating (SIGTERM) 22:55:34.581547 run iperf3-srv_10.42.42.10(pid=24826): Terminating (SIGTERM) 22:55:34.622183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24827): Terminating (SIGTERM) 22:55:34.662483 run iperf3-srv_10.42.42.10(pid=24828): Terminating (SIGTERM) 22:55:34.703109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24829): Terminating (SIGTERM) 22:55:34.743455 run iperf3-srv_10.42.42.10(pid=24830): Terminating (SIGTERM) 22:55:34.783612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24833): Terminating (SIGTERM) 22:55:34.823919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24836): Terminating (SIGTERM) 22:55:34.863988 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24839): Terminating (SIGTERM) 22:55:34.904883 --- ParallelTerminationStrategy: PID 24823 died... 22:55:34.923978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24823): Terminated: ok {rc=0} 22:55:34.969364 --- ParallelTerminationStrategy: PID 24824 died... 22:55:34.988114 run iperf3-srv_10.42.42.10(pid=24824): Terminated {rc=256} 22:55:35.032865 --- ParallelTerminationStrategy: PID 24825 died... 22:55:35.052057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24825): Terminated: ok {rc=0} 22:55:35.097108 --- ParallelTerminationStrategy: PID 24826 died... 22:55:35.115880 run iperf3-srv_10.42.42.10(pid=24826): Terminated {rc=256} 22:55:35.160553 --- ParallelTerminationStrategy: PID 24827 died... 22:55:35.179366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24827): Terminated: ok {rc=0} 22:55:35.224436 --- ParallelTerminationStrategy: PID 24828 died... 22:55:35.243101 run iperf3-srv_10.42.42.10(pid=24828): Terminated {rc=256} 22:55:35.287838 --- ParallelTerminationStrategy: PID 24829 died... 22:55:35.306647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24829): Terminated: ok {rc=0} 22:55:35.351551 --- ParallelTerminationStrategy: PID 24830 died... 22:55:35.370261 run iperf3-srv_10.42.42.10(pid=24830): Terminated {rc=256} 22:55:35.415426 --- ParallelTerminationStrategy: PID 24833 died... 22:55:35.434300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24833): Terminated: ok {rc=0} 22:55:35.479540 --- ParallelTerminationStrategy: PID 24836 died... 22:55:35.498346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24836): Terminated: ok {rc=0} 22:55:35.543866 --- ParallelTerminationStrategy: PID 24839 died... 22:55:35.562964 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24839): Terminated: ok {rc=0} 22:55:35.649888 bus /gobi_4: Setting Powered False 22:55:36.751235 bus /gobi_4: Setting Powered False 22:55:37.866503 bus /gobi_1: Setting Powered False 22:55:38.966612 bus /gobi_1: Setting Powered False 22:55:40.084570 bus /gobi_0: Setting Powered False 22:55:41.184217 bus /gobi_0: Setting Powered False 22:55:42.303330 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 22:55:43.408709 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:43.420923 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:55:43.474681 tst ping.py: using LAC 17321 22:55:43.600243 tst ping.py: using RAC 236 22:55:43.724874 tst ping.py: using CellId 17321 22:55:43.849254 tst ping.py: using BVCI 17322 22:55:43.965623 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:43.977287 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:43.988467 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:43.999893 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:44.011264 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:44.022613 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:44.034204 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:44.045620 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:44.163507 tst ping.py:19: start network... 22:55:44.378684 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:55:44.873512 run create_hlr_db(pid=24841): Launched 22:55:45.003686 bus /gobi_6: Setting Powered False 22:55:46.067207 run create_hlr_db(pid=24841): Terminated: ok {rc=0} 22:55:46.522134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24843): Launched 22:55:46.865695 run osmo-hlr_10.42.42.2(pid=24844): Launched 22:55:47.084918 run osmo-stp_10.42.42.5: Starting osmo-stp 22:55:47.674777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24846): Launched 22:55:47.993200 run osmo-stp_10.42.42.5(pid=24847): Launched 22:55:48.115073 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:55:48.668396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24849): Launched 22:55:48.791098 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:55:49.062006 run patchelf(pid=24850): Launched 22:55:49.240779 run osmo-stp_10.42.42.5(pid=24847): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24847)] 22:55:49.377156 run osmo-stp_10.42.42.5(pid=24847): stdout: | (launched: 2022-12-08_22:55:47.934986) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:49.514501 run osmo-stp_10.42.42.5(pid=24847): stderr: | 20221208225548125 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225548125 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225548125 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225548126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225548128 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225548128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225548128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:49.651918 run osmo-stp_10.42.42.5(pid=24847): stdout: | (launched: 2022-12-08_22:55:47.934986) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:49.783420 run osmo-stp_10.42.42.5(pid=24847): stderr: | 20221208225548125 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225548125 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225548125 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225548126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225548128 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225548128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225548128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:49.939214 run patchelf(pid=24850): Terminating (SIGINT) 22:55:50.120776 run patchelf(pid=24850): Terminated: ok {rc=0} 22:55:50.250244 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24847): Process ended prematurely: osmo-stp_10.42.42.5(pid=24847) [trial-2350↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24847)] [trial-2350↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 22:55:50.259759 tst ping.py:22: Test FAILED (6.8 sec) 22:55:50.288242 run osmo-hlr_10.42.42.2(pid=24844): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24844)] 22:55:50.338852 run osmo-hlr_10.42.42.2(pid=24844): stdout: | (launched: 2022-12-08_22:55:46.795905) 22:55:50.391169 run osmo-hlr_10.42.42.2(pid=24844): stderr: | 20221208225547009 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225547010 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225547010 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225547010 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225547010 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225547010 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225547023 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225547038 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225547042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225547042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:55:50.443669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24843): Terminating (SIGTERM) 22:55:50.486257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24846): Terminating (SIGTERM) 22:55:50.529035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24849): Terminating (SIGTERM) 22:55:50.571726 --- ParallelTerminationStrategy: PID 24843 died... 22:55:50.592155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24843): Terminated: ok {rc=0} 22:55:50.639365 --- ParallelTerminationStrategy: PID 24846 died... 22:55:50.659181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24846): Terminated: ok {rc=0} 22:55:50.706332 --- ParallelTerminationStrategy: PID 24849 died... 22:55:50.726398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24849): Terminated: ok {rc=0} 22:55:50.815604 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:55:51.903598 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:51.915554 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:55:51.965585 tst ping_idle_ping.py: using LAC 17322 22:55:52.086461 tst ping_idle_ping.py: using RAC 237 22:55:52.205116 tst ping_idle_ping.py: using CellId 17322 22:55:52.322860 tst ping_idle_ping.py: using BVCI 17323 22:55:52.432490 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:52.443522 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:52.454306 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:52.465280 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:52.476139 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:52.487031 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:52.498199 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:52.509259 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:52.623067 tst ping_idle_ping.py:24: start network... 22:55:52.825224 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:55:53.293397 run create_hlr_db(pid=24851): Launched 22:55:53.408287 bus /gobi_6: Setting Powered False 22:55:54.469198 run create_hlr_db(pid=24851): Terminated: ok {rc=0} 22:55:54.910116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24853): Launched 22:55:55.231504 run osmo-hlr_10.42.42.2(pid=24854): Launched 22:55:55.354004 run osmo-stp_10.42.42.5: Starting osmo-stp 22:55:55.907049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24856): Launched 22:55:56.228528 run osmo-stp_10.42.42.5(pid=24857): Launched 22:55:56.350513 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:55:56.905238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24859): Launched 22:55:57.027279 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:55:57.298653 run patchelf(pid=24860): Launched 22:55:57.477460 run osmo-stp_10.42.42.5(pid=24857): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24857)] 22:55:57.614015 run osmo-stp_10.42.42.5(pid=24857): stdout: | (launched: 2022-12-08_22:55:56.169925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:57.751826 run osmo-stp_10.42.42.5(pid=24857): stderr: | 20221208225556362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225556363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225556363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225556363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225556364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225556364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225556364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:57.889509 run osmo-stp_10.42.42.5(pid=24857): stdout: | (launched: 2022-12-08_22:55:56.169925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:58.021313 run osmo-stp_10.42.42.5(pid=24857): stderr: | 20221208225556362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225556363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225556363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225556363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225556364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225556364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225556364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:58.178324 run patchelf(pid=24860): Terminating (SIGINT) 22:55:58.359421 run patchelf(pid=24860): Terminated: ok {rc=0} 22:55:58.489466 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24857): Process ended prematurely: osmo-stp_10.42.42.5(pid=24857) [trial-2350↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24857)] [trial-2350↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 22:55:58.499107 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:55:58.527841 run osmo-hlr_10.42.42.2(pid=24854): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24854)] 22:55:58.579299 run osmo-hlr_10.42.42.2(pid=24854): stdout: | (launched: 2022-12-08_22:55:55.172453) 22:55:58.632354 run osmo-hlr_10.42.42.2(pid=24854): stderr: | 20221208225555369 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225555369 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225555369 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225555369 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225555369 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225555369 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225555383 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225555391 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225555391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225555391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:55:58.685587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24853): Terminating (SIGTERM) 22:55:58.728087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24856): Terminating (SIGTERM) 22:55:58.770856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24859): Terminating (SIGTERM) 22:55:58.813824 --- ParallelTerminationStrategy: PID 24853 died... 22:55:58.834127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24853): Terminated: ok {rc=0} 22:55:58.881431 --- ParallelTerminationStrategy: PID 24856 died... 22:55:58.901526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24856): Terminated: ok {rc=0} 22:55:58.948528 --- ParallelTerminationStrategy: PID 24859 died... 22:55:58.968457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24859): Terminated: ok {rc=0} 22:55:59.057163 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:56:00.361379 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:56:00.368253 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:56:00.402030 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:56:00.440845 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:56:00.526180 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:56:00.559593 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:56:00.599100 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:56:01.204819 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:56:01.260302 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:01.271838 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:56:01.337341 tst cs_paging_gprs_active.py: using LAC 17323 22:56:01.464838 tst cs_paging_gprs_active.py: using RAC 238 22:56:01.590908 tst cs_paging_gprs_active.py: using CellId 17323 22:56:01.714343 tst cs_paging_gprs_active.py: using BVCI 17324 22:56:01.834257 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:01.846857 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:01.859051 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:01.873186 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:01.885348 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:01.897852 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:01.910731 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:01.923391 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:01.936503 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:02.061493 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:02.192660 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:56:02.414880 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:02.742419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24864): Launched 22:56:03.025711 run iperf3-srv_10.42.42.10(pid=24865): Launched 22:56:03.149398 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:56:03.370571 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:03.699299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24866): Launched 22:56:03.982651 run iperf3-srv_10.42.42.10(pid=24867): Launched 22:56:04.106460 tst cs_paging_gprs_active.py:38: start network... 22:56:04.327095 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:56:04.836894 run create_hlr_db(pid=24868): Launched 22:56:04.970604 bus /gobi_6: Setting Powered False 22:56:06.036052 run create_hlr_db(pid=24868): Terminated: ok {rc=0} 22:56:06.491178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24870): Launched 22:56:06.818660 run osmo-hlr_10.42.42.2(pid=24871): Launched 22:56:06.942692 run osmo-stp_10.42.42.5: Starting osmo-stp 22:56:07.509345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24873): Launched 22:56:07.836309 run osmo-stp_10.42.42.5(pid=24874): Launched 22:56:07.961105 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:56:08.526752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24876): Launched 22:56:08.652502 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:56:08.930143 run patchelf(pid=24877): Launched 22:56:09.112877 run osmo-stp_10.42.42.5(pid=24874): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24874)] 22:56:09.251959 run osmo-stp_10.42.42.5(pid=24874): stdout: | (launched: 2022-12-08_22:56:07.776774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:09.392254 run osmo-stp_10.42.42.5(pid=24874): stderr: | 20221208225607971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225607971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225607971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225607972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225607972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225607972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225607972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:09.532551 run osmo-stp_10.42.42.5(pid=24874): stdout: | (launched: 2022-12-08_22:56:07.776774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:09.668096 run osmo-stp_10.42.42.5(pid=24874): stderr: | 20221208225607971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225607971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225607971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225607972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225607972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225607972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225607972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:09.828479 run patchelf(pid=24877): Terminating (SIGINT) 22:56:10.012062 run patchelf(pid=24877): Terminated: ok {rc=0} 22:56:10.144764 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24874): Process ended prematurely: osmo-stp_10.42.42.5(pid=24874) [trial-2350↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24874)] [trial-2350↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:56:10.155174 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 22:56:10.184306 run osmo-hlr_10.42.42.2(pid=24871): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24871)] 22:56:10.235510 run osmo-hlr_10.42.42.2(pid=24871): stdout: | (launched: 2022-12-08_22:56:06.759328) 22:56:10.288736 run osmo-hlr_10.42.42.2(pid=24871): stderr: | 20221208225606958 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225606958 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225606958 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225606958 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225606958 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225606958 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225606971 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225606982 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225606982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225606982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:56:10.341850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24864): Terminating (SIGTERM) 22:56:10.384623 run iperf3-srv_10.42.42.10(pid=24865): Terminating (SIGTERM) 22:56:10.427503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24866): Terminating (SIGTERM) 22:56:10.470508 run iperf3-srv_10.42.42.10(pid=24867): Terminating (SIGTERM) 22:56:10.513329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24870): Terminating (SIGTERM) 22:56:10.556718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24873): Terminating (SIGTERM) 22:56:10.599691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24876): Terminating (SIGTERM) 22:56:10.642940 --- ParallelTerminationStrategy: PID 24864 died... 22:56:10.663513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24864): Terminated: ok {rc=0} 22:56:10.711457 --- ParallelTerminationStrategy: PID 24865 died... 22:56:10.731458 run iperf3-srv_10.42.42.10(pid=24865): Terminated {rc=256} 22:56:10.778465 --- ParallelTerminationStrategy: PID 24866 died... 22:56:10.798515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24866): Terminated: ok {rc=0} 22:56:10.845590 --- ParallelTerminationStrategy: PID 24867 died... 22:56:10.865514 run iperf3-srv_10.42.42.10(pid=24867): Terminated {rc=256} 22:56:10.912440 --- ParallelTerminationStrategy: PID 24870 died... 22:56:10.932534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24870): Terminated: ok {rc=0} 22:56:10.979738 --- ParallelTerminationStrategy: PID 24873 died... 22:56:10.999708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24873): Terminated: ok {rc=0} 22:56:11.046860 --- ParallelTerminationStrategy: PID 24876 died... 22:56:11.067134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24876): Terminated: ok {rc=0} 22:56:11.157255 bus /gobi_0: Setting Powered False 22:56:12.258796 bus /gobi_0: Setting Powered False 22:56:13.377107 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:56:14.528235 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:14.540215 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:56:14.610638 tst iperf3.py: using LAC 17324 22:56:14.740864 tst iperf3.py: using RAC 239 22:56:14.869541 tst iperf3.py: using CellId 17324 22:56:14.998357 tst iperf3.py: using BVCI 17325 22:56:15.111336 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:15.122485 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:15.133193 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:15.144154 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:15.155262 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:15.166492 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:15.177611 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:15.188357 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:15.199627 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:15.314499 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:56:15.535074 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:15.870873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24878): Launched 22:56:16.190067 run iperf3-srv_10.42.42.10(pid=24879): Launched 22:56:16.328184 tst iperf3.py:8: start network... 22:56:16.552803 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:56:17.070335 run create_hlr_db(pid=24880): Launched 22:56:17.232011 bus /gobi_6: Setting Powered False 22:56:18.293932 run create_hlr_db(pid=24880): Terminated: ok {rc=0} 22:56:18.746717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24882): Launched 22:56:19.074088 run osmo-hlr_10.42.42.2(pid=24883): Launched 22:56:19.198949 run osmo-stp_10.42.42.5: Starting osmo-stp 22:56:19.764686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24885): Launched 22:56:20.090507 run osmo-stp_10.42.42.5(pid=24886): Launched 22:56:20.215014 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:56:20.778187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24888): Launched 22:56:20.902991 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:56:21.179248 run patchelf(pid=24889): Launched 22:56:21.360564 run osmo-stp_10.42.42.5(pid=24886): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24886)] 22:56:21.498648 run osmo-stp_10.42.42.5(pid=24886): stdout: | (launched: 2022-12-08_22:56:20.030839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:21.638261 run osmo-stp_10.42.42.5(pid=24886): stderr: | 20221208225620223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225620223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225620223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225620224 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225620224 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225620224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225620224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:21.777897 run osmo-stp_10.42.42.5(pid=24886): stdout: | (launched: 2022-12-08_22:56:20.030839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:21.911848 run osmo-stp_10.42.42.5(pid=24886): stderr: | 20221208225620223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225620223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225620223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225620224 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225620224 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225620224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225620224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:22.070847 run patchelf(pid=24889): Terminating (SIGINT) 22:56:22.254568 run patchelf(pid=24889): Terminated: ok {rc=0} 22:56:22.386787 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24886): Process ended prematurely: osmo-stp_10.42.42.5(pid=24886) [trial-2350↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24886)] [trial-2350↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 22:56:22.396900 tst iperf3.py:8: Test FAILED (7.9 sec) 22:56:22.425978 run osmo-hlr_10.42.42.2(pid=24883): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24883)] 22:56:22.477222 run osmo-hlr_10.42.42.2(pid=24883): stdout: | (launched: 2022-12-08_22:56:19.014874) 22:56:22.530021 run osmo-hlr_10.42.42.2(pid=24883): stderr: | 20221208225619212 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225619212 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225619212 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225619212 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225619212 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225619212 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225619225 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225619233 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225619233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225619233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:56:22.583392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24878): Terminating (SIGTERM) 22:56:22.625845 run iperf3-srv_10.42.42.10(pid=24879): Terminating (SIGTERM) 22:56:22.668259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24882): Terminating (SIGTERM) 22:56:22.710789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24885): Terminating (SIGTERM) 22:56:22.753304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24888): Terminating (SIGTERM) 22:56:22.796877 --- ParallelTerminationStrategy: PID 24878 died... 22:56:22.817308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24878): Terminated: ok {rc=0} 22:56:22.864356 --- ParallelTerminationStrategy: PID 24879 died... 22:56:22.884229 run iperf3-srv_10.42.42.10(pid=24879): Terminated {rc=256} 22:56:22.931303 --- ParallelTerminationStrategy: PID 24882 died... 22:56:22.951237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24882): Terminated: ok {rc=0} 22:56:22.998722 --- ParallelTerminationStrategy: PID 24885 died... 22:56:23.018665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24885): Terminated: ok {rc=0} 22:56:23.065661 --- ParallelTerminationStrategy: PID 24888 died... 22:56:23.085974 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24888): Terminated: ok {rc=0} 22:56:23.175095 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:56:24.327398 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:24.339415 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:56:24.406762 tst iperf3m4.py: using LAC 17325 22:56:24.533125 tst iperf3m4.py: using RAC 240 22:56:24.659958 tst iperf3m4.py: using CellId 17325 22:56:24.787151 tst iperf3m4.py: using BVCI 17326 22:56:24.906366 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:24.917780 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:24.928929 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:24.940136 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:24.951261 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:24.962458 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:24.973823 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:24.984934 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:24.996325 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:25.112525 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:25.234373 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:25.352034 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:25.467687 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:56:25.673297 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:25.980593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24890): Launched 22:56:26.248023 run iperf3-srv_10.42.42.10(pid=24891): Launched 22:56:26.363157 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:56:26.567265 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:26.874398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24892): Launched 22:56:27.139604 run iperf3-srv_10.42.42.10(pid=24893): Launched 22:56:27.254051 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:56:27.458104 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:27.764674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24894): Launched 22:56:28.030073 run iperf3-srv_10.42.42.10(pid=24895): Launched 22:56:28.144631 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:56:28.348664 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:28.655159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24896): Launched 22:56:28.921142 run iperf3-srv_10.42.42.10(pid=24897): Launched 22:56:29.035398 tst iperf3m4.py:8: start network... 22:56:29.239633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:56:29.711950 run create_hlr_db(pid=24898): Launched 22:56:29.829136 bus /gobi_6: Setting Powered False 22:56:30.912379 run create_hlr_db(pid=24898): Terminated: ok {rc=0} 22:56:31.461757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24900): Launched 22:56:31.807186 run osmo-hlr_10.42.42.2(pid=24901): Launched 22:56:32.058033 run osmo-stp_10.42.42.5: Starting osmo-stp 22:56:32.706871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24903): Launched 22:56:33.014425 run osmo-stp_10.42.42.5(pid=24904): Launched 22:56:33.131821 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:56:33.660592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24906): Launched 22:56:33.778009 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:56:34.037312 run patchelf(pid=24907): Launched 22:56:34.208215 run osmo-stp_10.42.42.5(pid=24904): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24904)] 22:56:34.337824 run osmo-stp_10.42.42.5(pid=24904): stdout: | (launched: 2022-12-08_22:56:32.958305) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:34.469186 run osmo-stp_10.42.42.5(pid=24904): stderr: | 20221208225633128 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225633128 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225633128 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225633128 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225633131 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225633131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225633131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:34.600638 run osmo-stp_10.42.42.5(pid=24904): stdout: | (launched: 2022-12-08_22:56:32.958305) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:34.726726 run osmo-stp_10.42.42.5(pid=24904): stderr: | 20221208225633128 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225633128 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225633128 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225633128 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225633131 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225633131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225633131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:34.876517 run patchelf(pid=24907): Terminating (SIGINT) 22:56:35.049703 run patchelf(pid=24907): Terminated: ok {rc=0} 22:56:35.174283 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24904): Process ended prematurely: osmo-stp_10.42.42.5(pid=24904) [trial-2350↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24904)] [trial-2350↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:56:35.183910 tst iperf3m4.py:8: Test FAILED (10.9 sec) 22:56:35.212400 run osmo-hlr_10.42.42.2(pid=24901): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24901)] 22:56:35.261502 run osmo-hlr_10.42.42.2(pid=24901): stdout: | (launched: 2022-12-08_22:56:31.746840) 22:56:35.312458 run osmo-hlr_10.42.42.2(pid=24901): stderr: | 20221208225631965 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225631965 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225631965 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225631965 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225631965 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225631966 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225631991 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225632016 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225632026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225632026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:56:35.363616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24890): Terminating (SIGTERM) 22:56:35.404287 run iperf3-srv_10.42.42.10(pid=24891): Terminating (SIGTERM) 22:56:35.445036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24892): Terminating (SIGTERM) 22:56:35.486159 run iperf3-srv_10.42.42.10(pid=24893): Terminating (SIGTERM) 22:56:35.526583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24894): Terminating (SIGTERM) 22:56:35.567208 run iperf3-srv_10.42.42.10(pid=24895): Terminating (SIGTERM) 22:56:35.607879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24896): Terminating (SIGTERM) 22:56:35.648271 run iperf3-srv_10.42.42.10(pid=24897): Terminating (SIGTERM) 22:56:35.688708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24900): Terminating (SIGTERM) 22:56:35.729278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24903): Terminating (SIGTERM) 22:56:35.769850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24906): Terminating (SIGTERM) 22:56:35.811187 --- ParallelTerminationStrategy: PID 24890 died... 22:56:35.830624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24890): Terminated: ok {rc=0} 22:56:35.876590 --- ParallelTerminationStrategy: PID 24891 died... 22:56:35.895690 run iperf3-srv_10.42.42.10(pid=24891): Terminated {rc=256} 22:56:35.940789 --- ParallelTerminationStrategy: PID 24892 died... 22:56:35.959804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24892): Terminated: ok {rc=0} 22:56:36.005406 --- ParallelTerminationStrategy: PID 24893 died... 22:56:36.024372 run iperf3-srv_10.42.42.10(pid=24893): Terminated {rc=256} 22:56:36.070016 --- ParallelTerminationStrategy: PID 24894 died... 22:56:36.089100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24894): Terminated: ok {rc=0} 22:56:36.134664 --- ParallelTerminationStrategy: PID 24895 died... 22:56:36.153757 run iperf3-srv_10.42.42.10(pid=24895): Terminated {rc=256} 22:56:36.199165 --- ParallelTerminationStrategy: PID 24896 died... 22:56:36.218272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24896): Terminated: ok {rc=0} 22:56:36.264383 --- ParallelTerminationStrategy: PID 24897 died... 22:56:36.283471 run iperf3-srv_10.42.42.10(pid=24897): Terminated {rc=256} 22:56:36.329258 --- ParallelTerminationStrategy: PID 24900 died... 22:56:36.348111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24900): Terminated: ok {rc=0} 22:56:36.393981 --- ParallelTerminationStrategy: PID 24903 died... 22:56:36.413200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24903): Terminated: ok {rc=0} 22:56:36.458833 --- ParallelTerminationStrategy: PID 24906 died... 22:56:36.478009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24906): Terminated: ok {rc=0} 22:56:36.564189 bus /gobi_4: Setting Powered False 22:56:37.663998 bus /gobi_4: Setting Powered False 22:56:38.782750 bus /gobi_1: Setting Powered False 22:56:39.881355 bus /gobi_1: Setting Powered False 22:56:40.999542 bus /gobi_0: Setting Powered False 22:56:42.100594 bus /gobi_0: Setting Powered False 22:56:43.218670 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:56:44.322224 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:44.334243 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:56:44.402890 tst ping.py: using LAC 17326 22:56:44.527979 tst ping.py: using RAC 241 22:56:44.656252 tst ping.py: using CellId 17326 22:56:44.777348 tst ping.py: using BVCI 17327 22:56:44.888772 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:44.900051 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:44.910902 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:44.922123 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:44.932788 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:44.944026 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:44.956230 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:44.967475 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:45.083416 tst ping.py:19: start network... 22:56:45.285469 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:56:45.750633 run create_hlr_db(pid=24909): Launched 22:56:45.865909 bus /gobi_6: Setting Powered False 22:56:46.929455 run create_hlr_db(pid=24909): Terminated: ok {rc=0} 22:56:47.385534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24911): Launched 22:56:47.708652 run osmo-hlr_10.42.42.2(pid=24912): Launched 22:56:47.830373 run osmo-stp_10.42.42.5: Starting osmo-stp 22:56:48.384578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24914): Launched 22:56:48.703870 run osmo-stp_10.42.42.5(pid=24915): Launched 22:56:48.825487 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:56:49.381482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24917): Launched 22:56:49.505025 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:56:49.777169 run patchelf(pid=24918): Launched 22:56:49.955398 run osmo-stp_10.42.42.5(pid=24915): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24915)] 22:56:50.092341 run osmo-stp_10.42.42.5(pid=24915): stdout: | (launched: 2022-12-08_22:56:48.645424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:50.230155 run osmo-stp_10.42.42.5(pid=24915): stderr: | 20221208225648837 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225648837 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225648838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225648838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225648839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225648839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225648839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:50.367689 run osmo-stp_10.42.42.5(pid=24915): stdout: | (launched: 2022-12-08_22:56:48.645424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:50.499299 run osmo-stp_10.42.42.5(pid=24915): stderr: | 20221208225648837 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225648837 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225648838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225648838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225648839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225648839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225648839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:50.655354 run patchelf(pid=24918): Terminating (SIGINT) 22:56:50.835936 run patchelf(pid=24918): Terminated: ok {rc=0} 22:56:50.965708 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24915): Process ended prematurely: osmo-stp_10.42.42.5(pid=24915) [trial-2350↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24915)] [trial-2350↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 22:56:50.975247 tst ping.py:22: Test FAILED (6.6 sec) 22:56:51.004277 run osmo-hlr_10.42.42.2(pid=24912): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24912)] 22:56:51.055324 run osmo-hlr_10.42.42.2(pid=24912): stdout: | (launched: 2022-12-08_22:56:47.650252) 22:56:51.108478 run osmo-hlr_10.42.42.2(pid=24912): stderr: | 20221208225647850 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225647850 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225647850 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225647850 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225647850 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225647851 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225647864 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225647872 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225647872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225647872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:56:51.161644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24911): Terminating (SIGTERM) 22:56:51.203970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24914): Terminating (SIGTERM) 22:56:51.246498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24917): Terminating (SIGTERM) 22:56:51.289350 --- ParallelTerminationStrategy: PID 24911 died... 22:56:51.309742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24911): Terminated: ok {rc=0} 22:56:51.357124 --- ParallelTerminationStrategy: PID 24914 died... 22:56:51.377077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24914): Terminated: ok {rc=0} 22:56:51.424178 --- ParallelTerminationStrategy: PID 24917 died... 22:56:51.444096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24917): Terminated: ok {rc=0} 22:56:51.532365 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:56:52.620663 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:52.632400 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:56:52.700652 tst ping_idle_ping.py: using LAC 17327 22:56:52.819948 tst ping_idle_ping.py: using RAC 242 22:56:52.938640 tst ping_idle_ping.py: using CellId 17327 22:56:53.060412 tst ping_idle_ping.py: using BVCI 17328 22:56:53.170097 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:53.181035 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:53.191818 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:53.202845 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:53.213746 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:53.224620 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:53.235603 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:53.246625 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:53.363636 tst ping_idle_ping.py:24: start network... 22:56:53.580444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:56:54.080728 run create_hlr_db(pid=24919): Launched 22:56:54.211703 bus /gobi_6: Setting Powered False 22:56:55.276749 run create_hlr_db(pid=24919): Terminated: ok {rc=0} 22:56:55.707928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24921): Launched 22:56:56.009566 run osmo-hlr_10.42.42.2(pid=24922): Launched 22:56:56.125156 run osmo-stp_10.42.42.5: Starting osmo-stp 22:56:56.656391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24924): Launched 22:56:56.957775 run osmo-stp_10.42.42.5(pid=24925): Launched 22:56:57.072584 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:56:57.593651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24927): Launched 22:56:57.710217 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:56:57.967697 run patchelf(pid=24928): Launched 22:56:58.136478 run osmo-stp_10.42.42.5(pid=24925): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24925)] 22:56:58.265434 run osmo-stp_10.42.42.5(pid=24925): stdout: | (launched: 2022-12-08_22:56:56.902429) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:58.395704 run osmo-stp_10.42.42.5(pid=24925): stderr: | 20221208225657071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225657071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225657072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225657072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225657074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225657075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225657075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:58.526473 run osmo-stp_10.42.42.5(pid=24925): stdout: | (launched: 2022-12-08_22:56:56.902429) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:58.650970 run osmo-stp_10.42.42.5(pid=24925): stderr: | 20221208225657071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225657071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225657072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225657072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225657074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225657075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225657075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:58.798479 run patchelf(pid=24928): Terminating (SIGINT) 22:56:58.969210 run patchelf(pid=24928): Terminated: ok {rc=0} 22:56:59.092297 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24925): Process ended prematurely: osmo-stp_10.42.42.5(pid=24925) [trial-2350↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24925)] [trial-2350↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:56:59.101465 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 22:56:59.129492 run osmo-hlr_10.42.42.2(pid=24922): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24922)] 22:56:59.178534 run osmo-hlr_10.42.42.2(pid=24922): stdout: | (launched: 2022-12-08_22:56:55.954062) 22:56:59.229576 run osmo-hlr_10.42.42.2(pid=24922): stderr: | 20221208225656128 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225656129 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225656129 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225656129 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225656129 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225656129 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225656141 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225656150 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225656150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225656150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:56:59.280872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24921): Terminating (SIGTERM) 22:56:59.322085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24924): Terminating (SIGTERM) 22:56:59.363450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24927): Terminating (SIGTERM) 22:56:59.405025 --- ParallelTerminationStrategy: PID 24921 died... 22:56:59.424635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24921): Terminated: ok {rc=0} 22:56:59.470685 --- ParallelTerminationStrategy: PID 24924 died... 22:56:59.490135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24924): Terminated: ok {rc=0} 22:56:59.536023 --- ParallelTerminationStrategy: PID 24927 died... 22:56:59.555288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24927): Terminated: ok {rc=0} 22:56:59.640371 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 22:57:00.981539 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:57:00.994213 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 22:57:01.029542 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 22:57:01.070444 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 22:57:01.158892 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 22:57:01.201163 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 22:57:01.249900 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 22:57:01.878694 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2350 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 22:57:01.945400 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:01.961878 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:57:02.023092 tst cs_paging_gprs_active.py: using LAC 17328 22:57:02.151131 tst cs_paging_gprs_active.py: using RAC 243 22:57:02.290138 tst cs_paging_gprs_active.py: using CellId 17328 22:57:02.416486 tst cs_paging_gprs_active.py: using BVCI 17329 22:57:02.535202 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:02.546940 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:02.558593 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:02.570333 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:02.581914 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:02.593430 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:02.605090 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:02.616463 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:02.628209 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:02.744624 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:02.864143 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:57:03.081995 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:03.405698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24933): Launched 22:57:03.687223 run iperf3-srv_10.42.42.10(pid=24934): Launched 22:57:03.808402 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:57:04.025063 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:04.349390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24935): Launched 22:57:04.630438 run iperf3-srv_10.42.42.10(pid=24936): Launched 22:57:04.751348 tst cs_paging_gprs_active.py:38: start network... 22:57:04.968835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:57:05.472007 run create_hlr_db(pid=24937): Launched 22:57:05.602986 bus /gobi_6: Setting Powered False 22:57:06.666681 run create_hlr_db(pid=24937): Terminated: ok {rc=0} 22:57:07.099528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24939): Launched 22:57:07.402105 run osmo-hlr_10.42.42.2(pid=24940): Launched 22:57:07.517328 run osmo-stp_10.42.42.5: Starting osmo-stp 22:57:08.049258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24942): Launched 22:57:08.353636 run osmo-stp_10.42.42.5(pid=24943): Launched 22:57:08.470341 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:57:08.996657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24945): Launched 22:57:09.112562 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:57:09.369545 run patchelf(pid=24946): Launched 22:57:09.539371 run osmo-stp_10.42.42.5(pid=24943): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24943)] 22:57:09.669288 run osmo-stp_10.42.42.5(pid=24943): stdout: | (launched: 2022-12-08_22:57:08.298312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:09.800641 run osmo-stp_10.42.42.5(pid=24943): stderr: | 20221208225708468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225708468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225708468 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225708469 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225708469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225708469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225708469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:09.932584 run osmo-stp_10.42.42.5(pid=24943): stdout: | (launched: 2022-12-08_22:57:08.298312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:10.059224 run osmo-stp_10.42.42.5(pid=24943): stderr: | 20221208225708468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225708468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225708468 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225708469 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225708469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225708469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225708469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:10.209327 run patchelf(pid=24946): Terminating (SIGINT) 22:57:10.381566 run patchelf(pid=24946): Terminated: ok {rc=0} 22:57:10.505877 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24943): Process ended prematurely: osmo-stp_10.42.42.5(pid=24943) [trial-2350↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24943)] [trial-2350↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 22:57:10.515418 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 22:57:10.543345 run osmo-hlr_10.42.42.2(pid=24940): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24940)] 22:57:10.592231 run osmo-hlr_10.42.42.2(pid=24940): stdout: | (launched: 2022-12-08_22:57:07.347306) 22:57:10.643243 run osmo-hlr_10.42.42.2(pid=24940): stderr: | 20221208225707521 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225707521 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225707522 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225707522 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225707522 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225707522 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225707534 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225707543 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225707543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225707543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:57:10.694282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24933): Terminating (SIGTERM) 22:57:10.734944 run iperf3-srv_10.42.42.10(pid=24934): Terminating (SIGTERM) 22:57:10.775668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24935): Terminating (SIGTERM) 22:57:10.816536 run iperf3-srv_10.42.42.10(pid=24936): Terminating (SIGTERM) 22:57:10.857447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24939): Terminating (SIGTERM) 22:57:10.898474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24942): Terminating (SIGTERM) 22:57:10.939225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24945): Terminating (SIGTERM) 22:57:10.980125 --- ParallelTerminationStrategy: PID 24933 died... 22:57:10.999429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24933): Terminated: ok {rc=0} 22:57:11.044552 --- ParallelTerminationStrategy: PID 24934 died... 22:57:11.063363 run iperf3-srv_10.42.42.10(pid=24934): Terminated {rc=256} 22:57:11.108361 --- ParallelTerminationStrategy: PID 24935 died... 22:57:11.127122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24935): Terminated: ok {rc=0} 22:57:11.172615 --- ParallelTerminationStrategy: PID 24936 died... 22:57:11.191470 run iperf3-srv_10.42.42.10(pid=24936): Terminated {rc=256} 22:57:11.236501 --- ParallelTerminationStrategy: PID 24939 died... 22:57:11.255308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24939): Terminated: ok {rc=0} 22:57:11.300271 --- ParallelTerminationStrategy: PID 24942 died... 22:57:11.319131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24942): Terminated: ok {rc=0} 22:57:11.364605 --- ParallelTerminationStrategy: PID 24945 died... 22:57:11.383537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24945): Terminated: ok {rc=0} 22:57:11.469171 bus /gobi_0: Setting Powered False 22:57:12.568050 bus /gobi_0: Setting Powered False 22:57:13.688098 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 22:57:14.835403 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:14.847388 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:57:14.897685 tst iperf3.py: using LAC 17329 22:57:15.025419 tst iperf3.py: using RAC 244 22:57:15.154121 tst iperf3.py: using CellId 17329 22:57:15.282015 tst iperf3.py: using BVCI 17330 22:57:15.399165 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:15.411084 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:15.422736 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:15.434404 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:15.446962 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:15.458720 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:15.470519 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:15.482143 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:15.494030 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:15.616802 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:57:15.833315 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:16.181811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24948): Launched 22:57:16.470845 run iperf3-srv_10.42.42.10(pid=24949): Launched 22:57:16.606067 tst iperf3.py:8: start network... 22:57:16.825324 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:57:17.331330 run create_hlr_db(pid=24950): Launched 22:57:17.461721 bus /gobi_6: Setting Powered False 22:57:18.525468 run create_hlr_db(pid=24950): Terminated: ok {rc=0} 22:57:18.957160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24952): Launched 22:57:19.261955 run osmo-hlr_10.42.42.2(pid=24953): Launched 22:57:19.377791 run osmo-stp_10.42.42.5: Starting osmo-stp 22:57:19.915010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24955): Launched 22:57:20.218790 run osmo-stp_10.42.42.5(pid=24956): Launched 22:57:20.334226 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:57:20.855699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24958): Launched 22:57:20.971529 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:57:21.228866 run patchelf(pid=24959): Launched 22:57:21.398906 run osmo-stp_10.42.42.5(pid=24956): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24956)] 22:57:21.528589 run osmo-stp_10.42.42.5(pid=24956): stdout: | (launched: 2022-12-08_22:57:20.162773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:21.659548 run osmo-stp_10.42.42.5(pid=24956): stderr: | 20221208225720333 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225720333 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225720333 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225720334 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225720336 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225720336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225720336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:21.791060 run osmo-stp_10.42.42.5(pid=24956): stdout: | (launched: 2022-12-08_22:57:20.162773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:21.917241 run osmo-stp_10.42.42.5(pid=24956): stderr: | 20221208225720333 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225720333 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225720333 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225720334 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225720336 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225720336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225720336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:22.066190 run patchelf(pid=24959): Terminating (SIGINT) 22:57:22.238724 run patchelf(pid=24959): Terminated: ok {rc=0} 22:57:22.362571 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24956): Process ended prematurely: osmo-stp_10.42.42.5(pid=24956) [trial-2350↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24956)] [trial-2350↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 22:57:22.372035 tst iperf3.py:8: Test FAILED (7.6 sec) 22:57:22.399984 run osmo-hlr_10.42.42.2(pid=24953): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24953)] 22:57:22.449072 run osmo-hlr_10.42.42.2(pid=24953): stdout: | (launched: 2022-12-08_22:57:19.206282) 22:57:22.499716 run osmo-hlr_10.42.42.2(pid=24953): stderr: | 20221208225719384 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225719384 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225719384 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225719384 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225719385 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225719385 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225719400 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225719409 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225719410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225719410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:57:22.550816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24948): Terminating (SIGTERM) 22:57:22.591118 run iperf3-srv_10.42.42.10(pid=24949): Terminating (SIGTERM) 22:57:22.631736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24952): Terminating (SIGTERM) 22:57:22.672319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24955): Terminating (SIGTERM) 22:57:22.712709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24958): Terminating (SIGTERM) 22:57:22.753330 --- ParallelTerminationStrategy: PID 24948 died... 22:57:22.772540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24948): Terminated: ok {rc=0} 22:57:22.818008 --- ParallelTerminationStrategy: PID 24949 died... 22:57:22.836666 run iperf3-srv_10.42.42.10(pid=24949): Terminated {rc=256} 22:57:22.881606 --- ParallelTerminationStrategy: PID 24952 died... 22:57:22.900300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24952): Terminated: ok {rc=0} 22:57:22.945249 --- ParallelTerminationStrategy: PID 24955 died... 22:57:22.963952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24955): Terminated: ok {rc=0} 22:57:23.009473 --- ParallelTerminationStrategy: PID 24958 died... 22:57:23.028227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24958): Terminated: ok {rc=0} 22:57:23.115380 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 22:57:24.264303 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:24.276160 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:57:24.331074 tst iperf3m4.py: using LAC 17330 22:57:24.450210 tst iperf3m4.py: using RAC 245 22:57:24.578350 tst iperf3m4.py: using CellId 17330 22:57:24.702900 tst iperf3m4.py: using BVCI 17331 22:57:24.820805 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:24.832494 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:24.844154 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:24.856299 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:24.868367 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:24.880438 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:24.892691 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:24.904682 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:24.917075 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:25.034034 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:25.156623 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:25.274349 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:25.390891 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:57:25.596175 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:25.901120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24960): Launched 22:57:26.164690 run iperf3-srv_10.42.42.10(pid=24961): Launched 22:57:26.278569 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:57:26.481885 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:26.786273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24962): Launched 22:57:27.068161 run iperf3-srv_10.42.42.10(pid=24963): Launched 22:57:27.190366 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:57:27.409805 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:27.734265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24964): Launched 22:57:28.014058 run iperf3-srv_10.42.42.10(pid=24965): Launched 22:57:28.135619 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:57:28.353411 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:28.677774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24966): Launched 22:57:28.958422 run iperf3-srv_10.42.42.10(pid=24967): Launched 22:57:29.079187 tst iperf3m4.py:8: start network... 22:57:29.297360 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:57:29.799034 run create_hlr_db(pid=24968): Launched 22:57:29.929521 bus /gobi_6: Setting Powered False 22:57:31.014019 run create_hlr_db(pid=24968): Terminated: ok {rc=0} 22:57:31.507293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24970): Launched 22:57:31.850011 run osmo-hlr_10.42.42.2(pid=24971): Launched 22:57:32.101772 run osmo-stp_10.42.42.5: Starting osmo-stp 22:57:32.651662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24973): Launched 22:57:32.955702 run osmo-stp_10.42.42.5(pid=24974): Launched 22:57:33.071528 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:57:33.597076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24976): Launched 22:57:33.713626 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:57:33.969991 run patchelf(pid=24977): Launched 22:57:34.138640 run osmo-stp_10.42.42.5(pid=24974): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24974)] 22:57:34.267540 run osmo-stp_10.42.42.5(pid=24974): stdout: | (launched: 2022-12-08_22:57:32.899966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:34.397623 run osmo-stp_10.42.42.5(pid=24974): stderr: | 20221208225733072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225733072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225733073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225733073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225733074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225733074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225733074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:34.528562 run osmo-stp_10.42.42.5(pid=24974): stdout: | (launched: 2022-12-08_22:57:32.899966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:34.653646 run osmo-stp_10.42.42.5(pid=24974): stderr: | 20221208225733072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225733072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225733073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225733073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225733074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225733074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225733074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:34.801960 run patchelf(pid=24977): Terminating (SIGINT) 22:57:34.972904 run patchelf(pid=24977): Terminated: ok {rc=0} 22:57:35.096192 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24974): Process ended prematurely: osmo-stp_10.42.42.5(pid=24974) [trial-2350↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24974)] [trial-2350↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 22:57:35.105802 tst iperf3m4.py:8: Test FAILED (10.9 sec) 22:57:35.133926 run osmo-hlr_10.42.42.2(pid=24971): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24971)] 22:57:35.182670 run osmo-hlr_10.42.42.2(pid=24971): stdout: | (launched: 2022-12-08_22:57:31.786949) 22:57:35.232920 run osmo-hlr_10.42.42.2(pid=24971): stderr: | 20221208225732034 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225732034 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225732034 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225732034 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225732035 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225732035 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225732050 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225732066 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225732067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225732067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:57:35.283778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24960): Terminating (SIGTERM) 22:57:35.324085 run iperf3-srv_10.42.42.10(pid=24961): Terminating (SIGTERM) 22:57:35.364692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24962): Terminating (SIGTERM) 22:57:35.405049 run iperf3-srv_10.42.42.10(pid=24963): Terminating (SIGTERM) 22:57:35.445250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24964): Terminating (SIGTERM) 22:57:35.485858 run iperf3-srv_10.42.42.10(pid=24965): Terminating (SIGTERM) 22:57:35.525976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24966): Terminating (SIGTERM) 22:57:35.566224 run iperf3-srv_10.42.42.10(pid=24967): Terminating (SIGTERM) 22:57:35.606489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24970): Terminating (SIGTERM) 22:57:35.646709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24973): Terminating (SIGTERM) 22:57:35.686868 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24976): Terminating (SIGTERM) 22:57:35.728932 --- ParallelTerminationStrategy: PID 24960 died... 22:57:35.748567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24960): Terminated: ok {rc=0} 22:57:35.794292 --- ParallelTerminationStrategy: PID 24961 died... 22:57:35.813009 run iperf3-srv_10.42.42.10(pid=24961): Terminated {rc=256} 22:57:35.857753 --- ParallelTerminationStrategy: PID 24962 died... 22:57:35.876611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24962): Terminated: ok {rc=0} 22:57:35.921433 --- ParallelTerminationStrategy: PID 24963 died... 22:57:35.940102 run iperf3-srv_10.42.42.10(pid=24963): Terminated {rc=256} 22:57:35.984640 --- ParallelTerminationStrategy: PID 24964 died... 22:57:36.003565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24964): Terminated: ok {rc=0} 22:57:36.048210 --- ParallelTerminationStrategy: PID 24965 died... 22:57:36.066958 run iperf3-srv_10.42.42.10(pid=24965): Terminated {rc=256} 22:57:36.111803 --- ParallelTerminationStrategy: PID 24966 died... 22:57:36.130614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24966): Terminated: ok {rc=0} 22:57:36.175398 --- ParallelTerminationStrategy: PID 24967 died... 22:57:36.194095 run iperf3-srv_10.42.42.10(pid=24967): Terminated {rc=256} 22:57:36.238918 --- ParallelTerminationStrategy: PID 24970 died... 22:57:36.257637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24970): Terminated: ok {rc=0} 22:57:36.302697 --- ParallelTerminationStrategy: PID 24973 died... 22:57:36.321469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24973): Terminated: ok {rc=0} 22:57:36.366361 --- ParallelTerminationStrategy: PID 24976 died... 22:57:36.385203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24976): Terminated: ok {rc=0} 22:57:36.472667 bus /gobi_4: Setting Powered False 22:57:37.572403 bus /gobi_4: Setting Powered False 22:57:38.690279 bus /gobi_1: Setting Powered False 22:57:39.789177 bus /gobi_1: Setting Powered False 22:57:40.907803 bus /gobi_0: Setting Powered False 22:57:42.007517 bus /gobi_0: Setting Powered False 22:57:43.125818 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 22:57:44.226876 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:44.238818 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:57:44.288425 tst ping.py: using LAC 17331 22:57:44.407280 tst ping.py: using RAC 246 22:57:44.529407 tst ping.py: using CellId 17331 22:57:44.646239 tst ping.py: using BVCI 17332 22:57:44.757088 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:44.768463 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:44.779617 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:44.790695 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:44.802150 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:44.814064 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:44.825562 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:44.836731 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:44.950414 tst ping.py:19: start network... 22:57:45.150100 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:57:45.612434 run create_hlr_db(pid=24983): Launched 22:57:45.726637 bus /gobi_6: Setting Powered False 22:57:46.785861 run create_hlr_db(pid=24983): Terminated: ok {rc=0} 22:57:47.260459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24985): Launched 22:57:47.578290 run osmo-hlr_10.42.42.2(pid=24986): Launched 22:57:47.699042 run osmo-stp_10.42.42.5: Starting osmo-stp 22:57:48.252702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24988): Launched 22:57:48.570384 run osmo-stp_10.42.42.5(pid=24989): Launched 22:57:48.691406 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:57:49.241220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24991): Launched 22:57:49.362796 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:57:49.632377 run patchelf(pid=24992): Launched 22:57:49.810114 run osmo-stp_10.42.42.5(pid=24989): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24989)] 22:57:49.945957 run osmo-stp_10.42.42.5(pid=24989): stdout: | (launched: 2022-12-08_22:57:48.512568) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:50.083264 run osmo-stp_10.42.42.5(pid=24989): stderr: | 20221208225748707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225748707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225748707 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225748708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225748708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225748708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225748708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:50.221199 run osmo-stp_10.42.42.5(pid=24989): stdout: | (launched: 2022-12-08_22:57:48.512568) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:50.352409 run osmo-stp_10.42.42.5(pid=24989): stderr: | 20221208225748707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225748707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225748707 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225748708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225748708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225748708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225748708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:50.507397 run patchelf(pid=24992): Terminating (SIGINT) 22:57:50.687124 run patchelf(pid=24992): Terminated: ok {rc=0} 22:57:50.816364 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24989): Process ended prematurely: osmo-stp_10.42.42.5(pid=24989) [trial-2350↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24989)] [trial-2350↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 22:57:50.826098 tst ping.py:22: Test FAILED (6.6 sec) 22:57:50.854685 run osmo-hlr_10.42.42.2(pid=24986): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24986)] 22:57:50.906014 run osmo-hlr_10.42.42.2(pid=24986): stdout: | (launched: 2022-12-08_22:57:47.520744) 22:57:50.959353 run osmo-hlr_10.42.42.2(pid=24986): stderr: | 20221208225747718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225747718 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225747718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225747718 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225747718 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225747718 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225747731 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225747739 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225747739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225747739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:57:51.013273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24985): Terminating (SIGTERM) 22:57:51.055874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24988): Terminating (SIGTERM) 22:57:51.098874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24991): Terminating (SIGTERM) 22:57:51.142379 --- ParallelTerminationStrategy: PID 24985 died... 22:57:51.162737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24985): Terminated: ok {rc=0} 22:57:51.210233 --- ParallelTerminationStrategy: PID 24988 died... 22:57:51.230186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24988): Terminated: ok {rc=0} 22:57:51.277541 --- ParallelTerminationStrategy: PID 24991 died... 22:57:51.297467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24991): Terminated: ok {rc=0} 22:57:51.387748 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2350 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 22:57:52.474560 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:52.486660 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:57:52.539755 tst ping_idle_ping.py: using LAC 17332 22:57:52.658510 tst ping_idle_ping.py: using RAC 247 22:57:52.783131 tst ping_idle_ping.py: using CellId 17332 22:57:52.899851 tst ping_idle_ping.py: using BVCI 17333 22:57:53.017126 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:53.029294 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:53.041170 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:53.053395 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:53.065435 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:53.077437 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:53.089744 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:53.101838 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:53.218518 tst ping_idle_ping.py:24: start network... 22:57:53.418679 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:57:53.884573 run create_hlr_db(pid=24993): Launched 22:57:53.999340 bus /gobi_6: Setting Powered False 22:57:55.059668 run create_hlr_db(pid=24993): Terminated: ok {rc=0} 22:57:55.477499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24995): Launched 22:57:55.778711 run osmo-hlr_10.42.42.2(pid=24996): Launched 22:57:55.893556 run osmo-stp_10.42.42.5: Starting osmo-stp 22:57:56.421466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24998): Launched 22:57:56.722013 run osmo-stp_10.42.42.5(pid=24999): Launched 22:57:56.836466 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:57:57.352262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25001): Launched 22:57:57.466506 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:57:57.720393 run patchelf(pid=25002): Launched 22:57:57.887301 run osmo-stp_10.42.42.5(pid=24999): ERR: Terminated: ERROR {rc=1} [trial-2350↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24999)] 22:57:58.015003 run osmo-stp_10.42.42.5(pid=24999): stdout: | (launched: 2022-12-08_22:57:56.667084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:58.144241 run osmo-stp_10.42.42.5(pid=24999): stderr: | 20221208225756838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225756838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225756839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225756839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225756840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225756840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225756840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:58.273832 run osmo-stp_10.42.42.5(pid=24999): stdout: | (launched: 2022-12-08_22:57:56.667084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:58.397674 run osmo-stp_10.42.42.5(pid=24999): stderr: | 20221208225756838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225756838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225756839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225756839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225756840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225756840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225756840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:58.544005 run patchelf(pid=25002): Terminating (SIGINT) 22:57:58.713682 run patchelf(pid=25002): Terminated: ok {rc=0} 22:57:58.835810 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24999): Process ended prematurely: osmo-stp_10.42.42.5(pid=24999) [trial-2350↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24999)] [trial-2350↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 22:57:58.844923 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:57:58.872234 run osmo-hlr_10.42.42.2(pid=24996): ERR: Terminated: ERROR {rc=237} [trial-2350↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24996)] 22:57:58.921457 run osmo-hlr_10.42.42.2(pid=24996): stdout: | (launched: 2022-12-08_22:57:55.723766) 22:57:58.972173 run osmo-hlr_10.42.42.2(pid=24996): stderr: | 20221208225755900 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225755900 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225755900 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225755900 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225755900 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225755900 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225755915 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225755925 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225755925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225755925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:57:59.023484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24995): Terminating (SIGTERM) 22:57:59.064313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24998): Terminating (SIGTERM) 22:57:59.105227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25001): Terminating (SIGTERM) 22:57:59.146325 --- ParallelTerminationStrategy: PID 24995 died... 22:57:59.165796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24995): Terminated: ok {rc=0} 22:57:59.211647 --- ParallelTerminationStrategy: PID 24998 died... 22:57:59.230758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24998): Terminated: ok {rc=0} 22:57:59.276668 --- ParallelTerminationStrategy: PID 25001 died... 22:57:59.295862 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25001): Terminated: ok {rc=0} 22:57:59.380941 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 22:58:00.702497 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:58:00.711153 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:58:00.745980 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:58:00.781605 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:58:00.835729 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:58:00.874787 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:58:00.920163 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:58:01.504185 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2350 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:58:01.510838 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:01.528817 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:58:01.613123 tst switch_tch_pdch.py: using LAC 17333 22:58:01.763131 tst switch_tch_pdch.py: using RAC 248 22:58:01.883503 tst switch_tch_pdch.py: using CellId 17333 22:58:02.042469 tst switch_tch_pdch.py: using BVCI 17334 22:58:02.171764 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:02.184272 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:02.197366 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:02.210482 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:02.223597 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:02.235920 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:02.250058 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:02.263506 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:58:02.381794 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:58:02.499084 tst switch_tch_pdch.py:51: start network... 22:58:02.699454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:58:03.160870 run create_hlr_db(pid=25006): Launched 22:58:03.275170 bus /gobi_6: Setting Powered False 22:58:04.335749 run create_hlr_db(pid=25006): Terminated: ok {rc=0} 22:58:04.751298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25008): Launched 22:58:05.048528 run osmo-hlr_10.42.42.2(pid=25009): Launched 22:58:05.161851 run osmo-stp_10.42.42.5: Starting osmo-stp 22:58:05.686439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25011): Launched 22:58:05.984752 run osmo-stp_10.42.42.5(pid=25012): Launched 22:58:06.098631 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:58:06.645214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25014): Launched 22:58:06.766805 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:58:07.035482 run patchelf(pid=25015): Launched 22:58:07.213245 run osmo-stp_10.42.42.5(pid=25012): ERR: Terminated: ERROR {rc=1} [trial-2350↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25012)] 22:58:07.349202 run osmo-stp_10.42.42.5(pid=25012): stdout: | (launched: 2022-12-08_22:58:05.930260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:07.486366 run osmo-stp_10.42.42.5(pid=25012): stderr: | 20221208225806098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225806098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225806098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225806099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225806101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225806101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225806101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:07.623739 run osmo-stp_10.42.42.5(pid=25012): stdout: | (launched: 2022-12-08_22:58:05.930260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:07.754999 run osmo-stp_10.42.42.5(pid=25012): stderr: | 20221208225806098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225806098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225806098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225806099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225806101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225806101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225806101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:07.910021 run patchelf(pid=25015): Terminating (SIGINT) 22:58:08.088780 run patchelf(pid=25015): Terminated: ok {rc=0} 22:58:08.218298 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=25012): Process ended prematurely: osmo-stp_10.42.42.5(pid=25012) [trial-2350↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25012)] [trial-2350↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:58:08.227904 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 22:58:08.256087 run osmo-hlr_10.42.42.2(pid=25009): ERR: Terminated: ERROR {rc=237} [trial-2350↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25009)] 22:58:08.308092 run osmo-hlr_10.42.42.2(pid=25009): stdout: | (launched: 2022-12-08_22:58:04.994231) 22:58:08.360755 run osmo-hlr_10.42.42.2(pid=25009): stderr: | 20221208225805168 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225805168 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225805168 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225805168 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225805168 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225805168 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225805180 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225805189 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225805190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225805190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:58:08.413806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25008): Terminating (SIGTERM) 22:58:08.456305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25011): Terminating (SIGTERM) 22:58:08.498862 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25014): Terminating (SIGTERM) 22:58:08.541361 --- ParallelTerminationStrategy: PID 25008 died... 22:58:08.561577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25008): Terminated: ok {rc=0} 22:58:08.608926 --- ParallelTerminationStrategy: PID 25011 died... 22:58:08.629156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25011): Terminated: ok {rc=0} 22:58:08.676069 --- ParallelTerminationStrategy: PID 25014 died... 22:58:08.695916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25014): Terminated: ok {rc=0} 22:58:08.784182 bus /gobi_0: Setting Powered False 22:58:09.883167 bus /gobi_0: Setting Powered False 22:58:10.999561 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2350 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 nitb_smpp --------------------------------------------------------------------- 22:58:12.254182 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:58:12.256702 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 22:58:12.276911 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 22:58:12.284421 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 22:58:12.319018 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 22:58:12.339991 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 22:58:12.346833 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 22:58:12.867187 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2350 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 22:58:12.873439 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 22:58:12.891642 tst esme_connect_policy_acceptall.py: using MSISDN 6890 22:58:13.037355 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:58:13.604614 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25020): Launched 22:58:13.909293 run osmo-nitb_10.42.42.2(pid=25021): Launched 22:58:14.078090 run osmo-nitb_10.42.42.2(pid=25021): ERR: Terminated: ERROR {rc=2} [trial-2350↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25021)] 22:58:14.215672 run osmo-nitb_10.42.42.2(pid=25021): stdout: | (launched: 2022-12-08_22:58:13.854222) 22:58:14.354489 run osmo-nitb_10.42.42.2(pid=25021): stderr: | (launched: 2022-12-08_22:58:13.899631) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:14.493121 run osmo-nitb_10.42.42.2(pid=25021): stdout: | (launched: 2022-12-08_22:58:13.854222) 22:58:14.626617 run osmo-nitb_10.42.42.2(pid=25021): stderr: | (launched: 2022-12-08_22:58:13.899631) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3c9519268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25021): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25021) [trial-2350↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25021)] 22:58:15.024108 tst osmo-nitb_10.42.42.2(pid=25021): stdout: | (launched: 2022-12-08_22:58:13.854222) 22:58:15.147394 tst osmo-nitb_10.42.42.2(pid=25021): stderr: | (launched: 2022-12-08_22:58:13.899631) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:15.292511 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=25021): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25021) [trial-2350↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25021)] [trial-2350↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 22:58:15.301094 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.4 sec) 22:58:15.307811 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25020): Terminating (SIGTERM) 22:58:15.518208 --- ParallelTerminationStrategy: PID 25020 died... 22:58:15.539486 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25020): Terminated: ok {rc=0} ---------------------------------------------- trial-2350 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 22:58:15.591720 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 22:58:15.610624 tst esme_connect_policy_closed.py: using MSISDN 6891 22:58:15.733939 tst esme_connect_policy_closed.py: using MSISDN 6892 22:58:15.857103 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:58:16.454124 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25022): Launched 22:58:16.797768 run osmo-nitb_10.42.42.2(pid=25023): Launched 22:58:16.968117 run osmo-nitb_10.42.42.2(pid=25023): ERR: Terminated: ERROR {rc=2} [trial-2350↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25023)] 22:58:17.098821 run osmo-nitb_10.42.42.2(pid=25023): stdout: | (launched: 2022-12-08_22:58:16.738407) 22:58:17.231155 run osmo-nitb_10.42.42.2(pid=25023): stderr: | (launched: 2022-12-08_22:58:16.786192) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:17.359273 run osmo-nitb_10.42.42.2(pid=25023): stdout: | (launched: 2022-12-08_22:58:16.738407) 22:58:17.481217 run osmo-nitb_10.42.42.2(pid=25023): stderr: | (launched: 2022-12-08_22:58:16.786192) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:17.627344 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=25023): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25023) [trial-2350↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25023)] [trial-2350↪nitb_smpp↪esme_connect_policy_closed.py:24] 22:58:17.635747 tst esme_connect_policy_closed.py:24: Test FAILED (2.0 sec) 22:58:17.642271 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25022): Terminating (SIGTERM) 22:58:17.852254 --- ParallelTerminationStrategy: PID 25022 died... 22:58:17.872886 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25022): Terminated: ok {rc=0} ---------------------------------------------- trial-2350 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 22:58:17.925134 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 22:58:17.936063 tst nitb_smpp: Using 1 x bts (candidates: 1) 22:58:17.969224 tst esme_ms_sms_storeforward.py: using LAC 17334 22:58:18.095194 tst esme_ms_sms_storeforward.py: using RAC 249 22:58:18.218797 tst esme_ms_sms_storeforward.py: using CellId 17334 22:58:18.338309 tst esme_ms_sms_storeforward.py: using BVCI 17335 22:58:18.451554 tst nitb_smpp: Using 1 x modem (candidates: 1) 22:58:18.577439 tst esme_ms_sms_storeforward.py: using MSISDN 6893 22:58:18.696756 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 22:58:18.918675 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:58:19.586887 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25024): Launched 22:58:19.916118 run osmo-nitb_10.42.42.2(pid=25025): Launched 22:58:20.093845 run osmo-nitb_10.42.42.2(pid=25025): ERR: Terminated: ERROR {rc=2} [trial-2350↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25025)] 22:58:20.230082 run osmo-nitb_10.42.42.2(pid=25025): stdout: | (launched: 2022-12-08_22:58:19.856822) 22:58:20.366805 run osmo-nitb_10.42.42.2(pid=25025): stderr: | (launched: 2022-12-08_22:58:19.906013) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:20.504079 run osmo-nitb_10.42.42.2(pid=25025): stdout: | (launched: 2022-12-08_22:58:19.856822) 22:58:20.635001 run osmo-nitb_10.42.42.2(pid=25025): stderr: | (launched: 2022-12-08_22:58:19.906013) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:20.791506 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=25025): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25025) [trial-2350↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25025)] [trial-2350↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 22:58:20.800360 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.9 sec) 22:58:20.807372 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25024): Terminating (SIGTERM) 22:58:21.018393 --- ParallelTerminationStrategy: PID 25024 died... 22:58:21.040293 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25024): Terminated: ok {rc=0} 22:58:21.129687 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 22:58:22.220370 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 22:58:22.231953 tst nitb_smpp: Using 1 x bts (candidates: 1) 22:58:22.266912 tst esme_ms_sms_transaction.py: using LAC 17335 22:58:22.398281 tst esme_ms_sms_transaction.py: using RAC 250 22:58:22.527724 tst esme_ms_sms_transaction.py: using CellId 17335 22:58:22.649537 tst esme_ms_sms_transaction.py: using BVCI 17336 22:58:22.769219 tst nitb_smpp: Using 1 x modem (candidates: 1) 22:58:22.899082 tst esme_ms_sms_transaction.py: using MSISDN 6894 22:58:23.016397 tst esme_ms_sms_transaction.py:18: start nitb and bts... 22:58:23.236607 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:58:23.896290 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25026): Launched 22:58:24.221875 run osmo-nitb_10.42.42.2(pid=25027): Launched 22:58:24.402258 run osmo-nitb_10.42.42.2(pid=25027): ERR: Terminated: ERROR {rc=2} [trial-2350↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25027)] 22:58:24.549136 run osmo-nitb_10.42.42.2(pid=25027): stdout: | (launched: 2022-12-08_22:58:24.163183) 22:58:24.697229 run osmo-nitb_10.42.42.2(pid=25027): stderr: | (launched: 2022-12-08_22:58:24.212025) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:24.845216 run osmo-nitb_10.42.42.2(pid=25027): stdout: | (launched: 2022-12-08_22:58:24.163183) 22:58:24.987694 run osmo-nitb_10.42.42.2(pid=25027): stderr: | (launched: 2022-12-08_22:58:24.212025) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa3c9519268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25027): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25027) [trial-2350↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25027)] 22:58:25.344307 tst osmo-nitb_10.42.42.2(pid=25027): stdout: | (launched: 2022-12-08_22:58:24.163183) 22:58:25.476380 tst osmo-nitb_10.42.42.2(pid=25027): stderr: | (launched: 2022-12-08_22:58:24.212025) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:25.631754 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=25027): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25027) [trial-2350↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25027)] [trial-2350↪nitb_smpp↪esme_ms_sms_transaction.py:21] 22:58:25.640857 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 22:58:25.647938 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25026): Terminating (SIGTERM) 22:58:25.858838 --- ParallelTerminationStrategy: PID 25026 died... 22:58:25.880611 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25026): Terminated: ok {rc=0} 22:58:25.969192 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 smpp --------------------------------------------------------------------- 22:58:27.137229 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:58:27.140306 tst smpp: Verifying 1 x bts (candidates: 11) 22:58:27.160641 tst smpp: Verifying 6 x ip_address (candidates: 9) 22:58:27.189459 tst smpp: Verifying 1 x modem (candidates: 12) 22:58:27.223742 tst smpp: Reserving 1 x bts (candidates: 11) 22:58:27.244033 tst smpp: Reserving 6 x ip_address (candidates: 9) 22:58:27.271821 tst smpp: Reserving 1 x modem (candidates: 12) 22:58:27.798073 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2350 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 22:58:27.803962 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:27.814525 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:27.824769 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:27.837129 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:27.856379 tst esme_connect_policy_acceptall.py: using MSISDN 6895 22:58:27.970721 run osmo-stp_10.42.42.4: Starting osmo-stp 22:58:28.492165 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=25031): Launched 22:58:28.799252 run osmo-stp_10.42.42.4(pid=25032): Launched 22:58:28.916907 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:58:29.390929 run create_hlr_db(pid=25033): Launched 22:58:29.506875 bus /sierra_2: Setting Powered False 22:58:30.567838 run create_hlr_db(pid=25033): Terminated: ok {rc=0} 22:58:31.029976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25035): Launched 22:58:31.355857 run osmo-hlr_10.42.42.2(pid=25036): Launched 22:58:31.601313 run osmo-msc_10.42.42.5: Starting osmo-msc 22:58:32.328282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25038): Launched 22:58:32.652846 run osmo-msc_10.42.42.5(pid=25039): Launched 22:58:32.829322 run osmo-hlr_10.42.42.2(pid=25036): ERR: Terminated: ERROR {rc=237} [trial-2350↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25036)] 22:58:32.964547 run osmo-hlr_10.42.42.2(pid=25036): stdout: | (launched: 2022-12-08_22:58:31.296767) 22:58:33.096287 run osmo-hlr_10.42.42.2(pid=25036): stderr: | 20221208225831639 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225831639 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225831640 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225831640 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225831641 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225831642 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225831665 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225831684 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225831685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225831686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:58:33.224848 run osmo-hlr_10.42.42.2(pid=25036): stdout: | (launched: 2022-12-08_22:58:31.296767) 22:58:33.346832 run osmo-hlr_10.42.42.2(pid=25036): stderr: | 20221208225831639 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225831639 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225831640 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225831640 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225831641 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225831642 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225831665 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225831684 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225831685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225831686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:58:33.492675 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=25036): Process ended prematurely: osmo-hlr_10.42.42.2(pid=25036) [trial-2350↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25036)] [trial-2350↪smpp↪esme_connect_policy_acceptall.py:23] 22:58:33.501102 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.7 sec) 22:58:33.527998 run osmo-msc_10.42.42.5(pid=25039): ERR: Terminated: ERROR {rc=9} [trial-2350↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=25039)] 22:58:33.576735 run osmo-msc_10.42.42.5(pid=25039): stdout: | (launched: 2022-12-08_22:58:32.594201) 22:58:33.627421 run osmo-msc_10.42.42.5(pid=25039): stderr: | 20221208225832909 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221208225832909 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221208225832909 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208225832909 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221208225832909 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221208225832909 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221208225832910 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221208225832910 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221208225832910 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 22:58:33.678301 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=25031): Terminating (SIGTERM) 22:58:33.718831 run osmo-stp_10.42.42.4(pid=25032): Terminating (SIGTERM) 22:58:33.759444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25035): Terminating (SIGTERM) 22:58:33.802429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25038): Terminating (SIGTERM) 22:58:33.846872 --- ParallelTerminationStrategy: PID 25031 died... 22:58:33.866123 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=25031): Terminated: ok {rc=0} 22:58:33.911986 --- ParallelTerminationStrategy: PID 25032 died... 22:58:33.930809 run osmo-stp_10.42.42.4(pid=25032): Terminated: ok {rc=0} 22:58:33.975986 --- ParallelTerminationStrategy: PID 25035 died... 22:58:33.994877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25035): Terminated: ok {rc=0} 22:58:34.040042 --- ParallelTerminationStrategy: PID 25038 died... 22:58:34.059048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25038): Terminated: ok {rc=0} ---------------------------------------------- trial-2350 smpp esme_connect_policy_closed.py ---------------------------------------------- 22:58:34.109871 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:34.120655 tst smpp: Using 1 x bts (candidates: 1) 22:58:34.157941 tst esme_connect_policy_closed.py: using LAC 17336 22:58:34.287734 tst esme_connect_policy_closed.py: using RAC 251 22:58:34.417382 tst esme_connect_policy_closed.py: using CellId 17336 22:58:34.544230 tst esme_connect_policy_closed.py: using BVCI 17337 22:58:34.657250 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:34.667723 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:34.678546 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:34.697734 tst esme_connect_policy_closed.py: using MSISDN 6896 22:58:34.825771 tst esme_connect_policy_closed.py: using MSISDN 6897 22:58:34.938276 run osmo-stp_10.42.42.4: Starting osmo-stp 22:58:35.462970 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=25042): Launched 22:58:35.770247 run osmo-stp_10.42.42.4(pid=25043): Launched 22:58:35.887433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:58:36.362643 run create_hlr_db(pid=25044): Launched 22:58:37.534389 run create_hlr_db(pid=25044): Terminated: ok {rc=0} 22:58:37.859491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25046): Launched 22:58:38.166203 run osmo-hlr_10.42.42.2(pid=25047): Launched 22:58:38.283786 run osmo-msc_10.42.42.5: Starting osmo-msc 22:58:38.844065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25049): Launched 22:58:39.150943 run osmo-msc_10.42.42.5(pid=25050): Launched 22:58:39.322316 run osmo-hlr_10.42.42.2(pid=25047): ERR: Terminated: ERROR {rc=237} [trial-2350↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25047)] 22:58:39.457921 run osmo-hlr_10.42.42.2(pid=25047): stdout: | (launched: 2022-12-08_22:58:38.110498) 22:58:39.600269 run osmo-hlr_10.42.42.2(pid=25047): stderr: | 20221208225838288 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225838288 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225838288 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225838288 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225838288 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225838288 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225838300 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225838308 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225838308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225838308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:58:39.734410 run osmo-hlr_10.42.42.2(pid=25047): stdout: | (launched: 2022-12-08_22:58:38.110498) 22:58:39.857493 run osmo-hlr_10.42.42.2(pid=25047): stderr: | 20221208225838288 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225838288 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225838288 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225838288 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225838288 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225838288 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225838300 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225838308 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225838308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225838308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:58:40.004886 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=25047): Process ended prematurely: osmo-hlr_10.42.42.2(pid=25047) [trial-2350↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25047)] [trial-2350↪smpp↪esme_connect_policy_closed.py:31] 22:58:40.013340 tst esme_connect_policy_closed.py:31: Test FAILED (5.9 sec) 22:58:40.040060 run osmo-msc_10.42.42.5(pid=25050): ERR: Terminated: ERROR {rc=9} [trial-2350↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=25050)] 22:58:40.089725 run osmo-msc_10.42.42.5(pid=25050): stdout: | (launched: 2022-12-08_22:58:39.095133) 22:58:40.140641 run osmo-msc_10.42.42.5(pid=25050): stderr: | 20221208225839412 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221208225839412 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221208225839413 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208225839413 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221208225839413 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221208225839413 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221208225839413 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221208225839413 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221208225839413 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 22:58:40.191956 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=25042): Terminating (SIGTERM) 22:58:40.232699 run osmo-stp_10.42.42.4(pid=25043): Terminating (SIGTERM) 22:58:40.273419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25046): Terminating (SIGTERM) 22:58:40.316383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25049): Terminating (SIGTERM) 22:58:40.359604 --- ParallelTerminationStrategy: PID 25042 died... 22:58:40.379428 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=25042): Terminated: ok {rc=0} 22:58:40.425499 --- ParallelTerminationStrategy: PID 25043 died... 22:58:40.444535 run osmo-stp_10.42.42.4(pid=25043): Terminated: ok {rc=0} 22:58:40.490043 --- ParallelTerminationStrategy: PID 25046 died... 22:58:40.509026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25046): Terminated: ok {rc=0} 22:58:40.554695 --- ParallelTerminationStrategy: PID 25049 died... 22:58:40.573896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25049): Terminated: ok {rc=0} ---------------------------------------------- trial-2350 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 22:58:40.626857 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:40.637815 tst smpp: Using 1 x bts (candidates: 1) 22:58:40.672118 tst esme_ms_sms_storeforward.py: using LAC 17337 22:58:40.794769 tst esme_ms_sms_storeforward.py: using RAC 252 22:58:40.918454 tst esme_ms_sms_storeforward.py: using CellId 17337 22:58:41.042145 tst esme_ms_sms_storeforward.py: using BVCI 17338 22:58:41.157110 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:41.167542 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:41.177853 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:41.188321 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:41.198999 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:41.209379 tst smpp: Using 1 x modem (candidates: 1) 22:58:41.339402 tst esme_ms_sms_storeforward.py: using MSISDN 6898 22:58:41.461379 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:58:41.969837 run create_hlr_db(pid=25053): Launched 22:58:43.162024 run create_hlr_db(pid=25053): Terminated: ok {rc=0} 22:58:43.507618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25055): Launched 22:58:43.833682 run osmo-hlr_10.42.42.2(pid=25056): Launched 22:58:43.959946 run osmo-stp_10.42.42.5: Starting osmo-stp 22:58:44.530268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25058): Launched 22:58:44.857690 run osmo-stp_10.42.42.5(pid=25059): Launched 22:58:44.982926 run osmo-msc_10.42.42.6: Starting osmo-msc 22:58:45.575574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25061): Launched 22:58:45.931157 run osmo-msc_10.42.42.6(pid=25062): Launched 22:58:46.389087 run osmo-stp_10.42.42.5(pid=25059): ERR: Terminated: ERROR {rc=1} [trial-2350↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25059)] 22:58:46.762523 run osmo-stp_10.42.42.5(pid=25059): stdout: | (launched: 2022-12-08_22:58:44.798534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:46.935469 run osmo-stp_10.42.42.5(pid=25059): stderr: | 20221208225844993 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225844994 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225844994 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225844994 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225844995 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225844995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225844995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:47.078738 run osmo-stp_10.42.42.5(pid=25059): stdout: | (launched: 2022-12-08_22:58:44.798534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:47.211482 run osmo-stp_10.42.42.5(pid=25059): stderr: | 20221208225844993 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225844994 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225844994 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225844994 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225844995 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225844995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225844995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:47.368791 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=25059): Process ended prematurely: osmo-stp_10.42.42.5(pid=25059) [trial-2350↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25059)] [trial-2350↪smpp↪esme_ms_sms_storeforward.py:30] 22:58:47.377899 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.7 sec) 22:58:47.405564 run osmo-hlr_10.42.42.2(pid=25056): ERR: Terminated: ERROR {rc=237} [trial-2350↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25056)] 22:58:47.456913 run osmo-hlr_10.42.42.2(pid=25056): stdout: | (launched: 2022-12-08_22:58:43.774942) 22:58:47.510143 run osmo-hlr_10.42.42.2(pid=25056): stderr: | 20221208225843972 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225843972 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225843972 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225843972 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225843973 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225843973 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225843986 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225843994 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225843995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225843995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:58:47.584133 run osmo-msc_10.42.42.6(pid=25062): ERR: Terminated: ERROR {rc=2} [trial-2350↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25062)] 22:58:47.635321 run osmo-msc_10.42.42.6(pid=25062): stdout: | (launched: 2022-12-08_22:58:45.852666) 22:58:47.688269 run osmo-msc_10.42.42.6(pid=25062): stderr: | 20221208225846439 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208225846439 DLGLOBAL DEBUG validating counter group 0x7f6dec5cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208225846439 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208225846439 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208225846439 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208225846439 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208225846443 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208225846444 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208225846445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208225846445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:58:47.741496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25055): Terminating (SIGTERM) 22:58:47.784243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25058): Terminating (SIGTERM) 22:58:47.827381 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25061): Terminating (SIGTERM) 22:58:47.870579 --- ParallelTerminationStrategy: PID 25055 died... 22:58:47.891078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25055): Terminated: ok {rc=0} 22:58:47.938999 --- ParallelTerminationStrategy: PID 25058 died... 22:58:47.959077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25058): Terminated: ok {rc=0} 22:58:48.006374 --- ParallelTerminationStrategy: PID 25061 died... 22:58:48.026300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25061): Terminated: ok {rc=0} 22:58:48.115747 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 smpp esme_ms_sms_transaction.py ---------------------------------------------- 22:58:49.206058 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:49.218114 tst smpp: Using 1 x bts (candidates: 1) 22:58:49.253470 tst esme_ms_sms_transaction.py: using LAC 17338 22:58:49.386265 tst esme_ms_sms_transaction.py: using RAC 253 22:58:49.516646 tst esme_ms_sms_transaction.py: using CellId 17338 22:58:49.645059 tst esme_ms_sms_transaction.py: using BVCI 17339 22:58:49.763558 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:49.774404 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:49.785247 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:49.795916 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:49.806640 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:49.817238 tst smpp: Using 1 x modem (candidates: 1) 22:58:49.942060 tst esme_ms_sms_transaction.py: using MSISDN 6899 22:58:50.054492 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:58:50.531959 run create_hlr_db(pid=25064): Launched 22:58:50.649354 bus /sierra_2: Setting Powered False 22:58:51.710239 run create_hlr_db(pid=25064): Terminated: ok {rc=0} 22:58:52.159511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25066): Launched 22:58:52.487926 run osmo-hlr_10.42.42.2(pid=25067): Launched 22:58:52.613801 run osmo-stp_10.42.42.5: Starting osmo-stp 22:58:53.179599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25069): Launched 22:58:53.505518 run osmo-stp_10.42.42.5(pid=25070): Launched 22:58:53.631518 run osmo-msc_10.42.42.6: Starting osmo-msc 22:58:54.226241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25072): Launched 22:58:54.553711 run osmo-msc_10.42.42.6(pid=25073): Launched 22:58:54.737595 run osmo-stp_10.42.42.5(pid=25070): ERR: Terminated: ERROR {rc=1} [trial-2350↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25070)] 22:58:54.876533 run osmo-stp_10.42.42.5(pid=25070): stdout: | (launched: 2022-12-08_22:58:53.446455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:55.016284 run osmo-stp_10.42.42.5(pid=25070): stderr: | 20221208225853640 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225853640 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225853640 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225853641 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225853641 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225853641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225853641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:55.155236 run osmo-stp_10.42.42.5(pid=25070): stdout: | (launched: 2022-12-08_22:58:53.446455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:55.286789 run osmo-stp_10.42.42.5(pid=25070): stderr: | 20221208225853640 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225853640 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225853640 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225853641 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225853641 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225853641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225853641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:55.443673 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=25070): Process ended prematurely: osmo-stp_10.42.42.5(pid=25070) [trial-2350↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25070)] [trial-2350↪smpp↪esme_ms_sms_transaction.py:28] 22:58:55.452628 tst esme_ms_sms_transaction.py:28: Test FAILED (6.2 sec) 22:58:55.480220 run osmo-hlr_10.42.42.2(pid=25067): ERR: Terminated: ERROR {rc=237} [trial-2350↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25067)] 22:58:55.531429 run osmo-hlr_10.42.42.2(pid=25067): stdout: | (launched: 2022-12-08_22:58:52.428690) 22:58:55.584542 run osmo-hlr_10.42.42.2(pid=25067): stderr: | 20221208225852629 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225852629 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225852629 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225852629 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225852629 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225852629 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225852641 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225852650 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225852650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225852650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:58:55.658242 run osmo-msc_10.42.42.6(pid=25073): ERR: Terminated: ERROR {rc=2} [trial-2350↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25073)] 22:58:55.709351 run osmo-msc_10.42.42.6(pid=25073): stdout: | (launched: 2022-12-08_22:58:54.494754) 22:58:55.762296 run osmo-msc_10.42.42.6(pid=25073): stderr: | 20221208225854821 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208225854821 DLGLOBAL DEBUG validating counter group 0x7f685f7a3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208225854821 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208225854821 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208225854821 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208225854822 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208225854823 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208225854824 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208225854824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208225854824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:58:55.815241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25066): Terminating (SIGTERM) 22:58:55.857762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25069): Terminating (SIGTERM) 22:58:55.900285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25072): Terminating (SIGTERM) 22:58:55.943242 --- ParallelTerminationStrategy: PID 25066 died... 22:58:55.963793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25066): Terminated: ok {rc=0} 22:58:56.011711 --- ParallelTerminationStrategy: PID 25069 died... 22:58:56.031694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25069): Terminated: ok {rc=0} 22:58:56.078722 --- ParallelTerminationStrategy: PID 25072 died... 22:58:56.098700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25072): Terminated: ok {rc=0} 22:58:56.187597 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 encryption --------------------------------------------------------------------- 22:58:57.384379 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:58:57.387680 tst encryption: Verifying 1 x bts (candidates: 11) 22:58:57.409024 tst encryption: Verifying 6 x ip_address (candidates: 9) 22:58:57.436392 tst encryption: Verifying 1 x modem (candidates: 12) 22:58:57.471761 tst encryption: Reserving 1 x bts (candidates: 11) 22:58:57.493480 tst encryption: Reserving 6 x ip_address (candidates: 9) 22:58:57.521149 tst encryption: Reserving 1 x modem (candidates: 12) 22:58:58.047511 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2350 encryption register_a5_0_authopt.py ---------------------------------------------- 22:58:58.102548 tst encryption: Using 1 x ip_address (candidates: 6) 22:58:58.113145 tst encryption: Using 1 x bts (candidates: 1) 22:58:58.148204 tst register_a5_0_authopt.py: using LAC 17339 22:58:58.273696 tst register_a5_0_authopt.py: using RAC 254 22:58:58.400441 tst register_a5_0_authopt.py: using CellId 17339 22:58:58.522239 tst register_a5_0_authopt.py: using BVCI 17340 22:58:58.636817 tst encryption: Using 1 x ip_address (candidates: 6) 22:58:58.647294 tst encryption: Using 1 x ip_address (candidates: 6) 22:58:58.657689 tst encryption: Using 1 x ip_address (candidates: 6) 22:58:58.668270 tst encryption: Using 1 x ip_address (candidates: 6) 22:58:58.678823 tst encryption: Using 1 x ip_address (candidates: 6) 22:58:58.689356 tst encryption: Using 1 x modem (candidates: 1) 22:58:58.807339 tst register_a5_0_authopt.py:8: start network... 22:58:59.033034 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:58:59.547318 run create_hlr_db(pid=25078): Launched 22:58:59.681932 bus /sierra_2: Setting Powered False 22:59:00.748076 run create_hlr_db(pid=25078): Terminated: ok {rc=0} 22:59:01.232546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25080): Launched 22:59:01.573780 run osmo-hlr_10.42.42.2(pid=25081): Launched 22:59:01.694596 run osmo-stp_10.42.42.5: Starting osmo-stp 22:59:02.423317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25083): Launched 22:59:02.733508 run osmo-stp_10.42.42.5(pid=25084): Launched 22:59:02.853920 run osmo-msc_10.42.42.6: Starting osmo-msc 22:59:03.416481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25086): Launched 22:59:03.726572 run osmo-msc_10.42.42.6(pid=25087): Launched 22:59:03.900319 run osmo-stp_10.42.42.5(pid=25084): ERR: Terminated: ERROR {rc=1} [trial-2350↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25084)] 22:59:04.032341 run osmo-stp_10.42.42.5(pid=25084): stdout: | (launched: 2022-12-08_22:59:02.677204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:04.164902 run osmo-stp_10.42.42.5(pid=25084): stderr: | 20221208225902850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225902850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225902851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225902851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225902851 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225902851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225902852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:04.295204 run osmo-stp_10.42.42.5(pid=25084): stdout: | (launched: 2022-12-08_22:59:02.677204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:04.419136 run osmo-stp_10.42.42.5(pid=25084): stderr: | 20221208225902850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225902850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225902851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225902851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225902851 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225902851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225902852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:04.567237 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25084): Process ended prematurely: osmo-stp_10.42.42.5(pid=25084) [trial-2350↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25084)] [trial-2350↪encryption↪register_a5_0_authopt.py:8] 22:59:04.576274 tst register_a5_0_authopt.py:8: Test FAILED (6.5 sec) 22:59:04.603407 run osmo-hlr_10.42.42.2(pid=25081): ERR: Terminated: ERROR {rc=237} [trial-2350↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25081)] 22:59:04.652348 run osmo-hlr_10.42.42.2(pid=25081): stdout: | (launched: 2022-12-08_22:59:01.506264) 22:59:04.702888 run osmo-hlr_10.42.42.2(pid=25081): stderr: | 20221208225901869 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225901869 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225901869 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225901869 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225901870 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225901870 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225901889 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225901898 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225901898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225901898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:59:04.773557 run osmo-msc_10.42.42.6(pid=25087): ERR: Terminated: ERROR {rc=2} [trial-2350↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25087)] 22:59:04.822383 run osmo-msc_10.42.42.6(pid=25087): stdout: | (launched: 2022-12-08_22:59:03.670243) 22:59:04.872685 run osmo-msc_10.42.42.6(pid=25087): stderr: | 20221208225903943 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208225903943 DLGLOBAL DEBUG validating counter group 0x7fdd52ee4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208225903943 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208225903943 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208225903943 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208225903944 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208225903945 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208225903946 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208225903946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208225903946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:59:04.923437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25080): Terminating (SIGTERM) 22:59:04.963802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25083): Terminating (SIGTERM) 22:59:05.004411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25086): Terminating (SIGTERM) 22:59:05.045281 --- ParallelTerminationStrategy: PID 25080 died... 22:59:05.064424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25080): Terminated: ok {rc=0} 22:59:05.109638 --- ParallelTerminationStrategy: PID 25083 died... 22:59:05.128582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25083): Terminated: ok {rc=0} 22:59:05.173787 --- ParallelTerminationStrategy: PID 25086 died... 22:59:05.192699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25086): Terminated: ok {rc=0} 22:59:05.279918 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 encryption register_a5_0_authreq.py ---------------------------------------------- 22:59:06.436831 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:06.448092 tst encryption: Using 1 x bts (candidates: 1) 22:59:06.484203 tst register_a5_0_authreq.py: using LAC 17340 22:59:06.608529 tst register_a5_0_authreq.py: using RAC 255 22:59:06.732660 tst register_a5_0_authreq.py: using CellId 17340 22:59:06.856141 tst register_a5_0_authreq.py: using BVCI 17341 22:59:06.971081 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:06.981587 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:06.991862 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:07.002359 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:07.012731 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:07.023155 tst encryption: Using 1 x modem (candidates: 1) 22:59:07.142169 tst register_a5_0_authreq.py:8: start network... 22:59:07.366589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:59:07.877547 run create_hlr_db(pid=25089): Launched 22:59:08.012114 bus /sierra_2: Setting Powered False 22:59:09.078012 run create_hlr_db(pid=25089): Terminated: ok {rc=0} 22:59:09.520777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25091): Launched 22:59:09.832253 run osmo-hlr_10.42.42.2(pid=25092): Launched 22:59:09.951186 run osmo-stp_10.42.42.5: Starting osmo-stp 22:59:10.499068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25094): Launched 22:59:10.809694 run osmo-stp_10.42.42.5(pid=25095): Launched 22:59:10.929824 run osmo-msc_10.42.42.6: Starting osmo-msc 22:59:11.491728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25097): Launched 22:59:11.802957 run osmo-msc_10.42.42.6(pid=25098): Launched 22:59:11.976373 run osmo-stp_10.42.42.5(pid=25095): ERR: Terminated: ERROR {rc=1} [trial-2350↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25095)] 22:59:12.113209 run osmo-stp_10.42.42.5(pid=25095): stdout: | (launched: 2022-12-08_22:59:10.753274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:12.246474 run osmo-stp_10.42.42.5(pid=25095): stderr: | 20221208225910923 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225910923 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225910924 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225910924 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225910925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225910925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225910925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:12.376585 run osmo-stp_10.42.42.5(pid=25095): stdout: | (launched: 2022-12-08_22:59:10.753274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:12.500297 run osmo-stp_10.42.42.5(pid=25095): stderr: | 20221208225910923 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225910923 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225910924 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225910924 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225910925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225910925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225910925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:12.648371 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25095): Process ended prematurely: osmo-stp_10.42.42.5(pid=25095) [trial-2350↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25095)] [trial-2350↪encryption↪register_a5_0_authreq.py:8] 22:59:12.657455 tst register_a5_0_authreq.py:8: Test FAILED (6.3 sec) 22:59:12.684404 run osmo-hlr_10.42.42.2(pid=25092): ERR: Terminated: ERROR {rc=237} [trial-2350↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25092)] 22:59:12.733821 run osmo-hlr_10.42.42.2(pid=25092): stdout: | (launched: 2022-12-08_22:59:09.775487) 22:59:12.784135 run osmo-hlr_10.42.42.2(pid=25092): stderr: | 20221208225909952 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225909952 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225909952 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225909952 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225909952 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225909952 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225909965 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225909973 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225909973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225909973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:59:12.854311 run osmo-msc_10.42.42.6(pid=25098): ERR: Terminated: ERROR {rc=2} [trial-2350↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25098)] 22:59:12.902989 run osmo-msc_10.42.42.6(pid=25098): stdout: | (launched: 2022-12-08_22:59:11.746195) 22:59:12.953284 run osmo-msc_10.42.42.6(pid=25098): stderr: | 20221208225912020 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208225912020 DLGLOBAL DEBUG validating counter group 0x7f44b20f8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208225912020 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208225912020 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208225912020 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208225912020 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208225912022 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208225912022 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208225912023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208225912023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:59:13.003782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25091): Terminating (SIGTERM) 22:59:13.044115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25094): Terminating (SIGTERM) 22:59:13.084769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25097): Terminating (SIGTERM) 22:59:13.125556 --- ParallelTerminationStrategy: PID 25091 died... 22:59:13.144655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25091): Terminated: ok {rc=0} 22:59:13.190109 --- ParallelTerminationStrategy: PID 25094 died... 22:59:13.208838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25094): Terminated: ok {rc=0} 22:59:13.254041 --- ParallelTerminationStrategy: PID 25097 died... 22:59:13.273024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25097): Terminated: ok {rc=0} 22:59:13.360015 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 encryption register_a5_1_authreq.py ---------------------------------------------- 22:59:14.514123 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:14.525269 tst encryption: Using 1 x bts (candidates: 1) 22:59:14.564128 tst register_a5_1_authreq.py: using LAC 17341 22:59:14.687410 tst register_a5_1_authreq.py: using RAC 1 22:59:14.817496 tst register_a5_1_authreq.py: using CellId 17341 22:59:14.946560 tst register_a5_1_authreq.py: using BVCI 17342 22:59:15.067776 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:15.078854 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:15.089886 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:15.100758 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:15.111489 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:15.122238 tst encryption: Using 1 x modem (candidates: 1) 22:59:15.242632 tst register_a5_1_authreq.py:8: start network... 22:59:15.466757 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:59:15.997356 run create_hlr_db(pid=25100): Launched 22:59:16.178601 bus /sierra_2: Setting Powered False 22:59:17.243630 run create_hlr_db(pid=25100): Terminated: ok {rc=0} 22:59:17.727809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25102): Launched 22:59:18.058589 run osmo-hlr_10.42.42.2(pid=25103): Launched 22:59:18.185617 run osmo-stp_10.42.42.5: Starting osmo-stp 22:59:18.757279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25105): Launched 22:59:19.088194 run osmo-stp_10.42.42.5(pid=25106): Launched 22:59:19.214722 run osmo-msc_10.42.42.6: Starting osmo-msc 22:59:19.816236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25108): Launched 22:59:20.148064 run osmo-msc_10.42.42.6(pid=25109): Launched 22:59:20.333222 run osmo-stp_10.42.42.5(pid=25106): ERR: Terminated: ERROR {rc=1} [trial-2350↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25106)] 22:59:20.472911 run osmo-stp_10.42.42.5(pid=25106): stdout: | (launched: 2022-12-08_22:59:19.028286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:20.613674 run osmo-stp_10.42.42.5(pid=25106): stderr: | 20221208225919222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225919223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225919223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225919223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225919226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225919226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225919226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:20.753707 run osmo-stp_10.42.42.5(pid=25106): stdout: | (launched: 2022-12-08_22:59:19.028286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:20.886455 run osmo-stp_10.42.42.5(pid=25106): stderr: | 20221208225919222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225919223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225919223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225919223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225919226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225919226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225919226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:21.045125 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25106): Process ended prematurely: osmo-stp_10.42.42.5(pid=25106) [trial-2350↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25106)] [trial-2350↪encryption↪register_a5_1_authreq.py:8] 22:59:21.054877 tst register_a5_1_authreq.py:8: Test FAILED (6.6 sec) 22:59:21.083471 run osmo-hlr_10.42.42.2(pid=25103): ERR: Terminated: ERROR {rc=237} [trial-2350↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25103)] 22:59:21.134692 run osmo-hlr_10.42.42.2(pid=25103): stdout: | (launched: 2022-12-08_22:59:17.998953) 22:59:21.188070 run osmo-hlr_10.42.42.2(pid=25103): stderr: | 20221208225918199 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225918199 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225918200 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225918200 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225918200 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225918200 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225918215 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225918226 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225918226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225918226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:59:21.261776 run osmo-msc_10.42.42.6(pid=25109): ERR: Terminated: ERROR {rc=2} [trial-2350↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25109)] 22:59:21.312797 run osmo-msc_10.42.42.6(pid=25109): stdout: | (launched: 2022-12-08_22:59:20.088158) 22:59:21.365509 run osmo-msc_10.42.42.6(pid=25109): stderr: | 20221208225920414 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208225920414 DLGLOBAL DEBUG validating counter group 0x7f469710ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208225920414 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208225920415 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208225920415 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208225920415 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208225920417 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208225920417 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208225920417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208225920417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:59:21.418445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25102): Terminating (SIGTERM) 22:59:21.460831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25105): Terminating (SIGTERM) 22:59:21.503645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25108): Terminating (SIGTERM) 22:59:21.546556 --- ParallelTerminationStrategy: PID 25102 died... 22:59:21.566851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25102): Terminated: ok {rc=0} 22:59:21.614432 --- ParallelTerminationStrategy: PID 25105 died... 22:59:21.634436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25105): Terminated: ok {rc=0} 22:59:21.681650 --- ParallelTerminationStrategy: PID 25108 died... 22:59:21.701595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25108): Terminated: ok {rc=0} 22:59:21.790781 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2350 encryption register_a5_3_authreq.py ---------------------------------------------- 22:59:22.947609 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:22.959278 tst encryption: Using 1 x bts (candidates: 1) 22:59:23.000101 tst register_a5_3_authreq.py: using LAC 17342 22:59:23.130617 tst register_a5_3_authreq.py: using RAC 2 22:59:23.260179 tst register_a5_3_authreq.py: using CellId 17342 22:59:23.383405 tst register_a5_3_authreq.py: using BVCI 17343 22:59:23.499127 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:23.509840 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:23.520327 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:23.531790 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:23.542976 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:23.553965 tst encryption: Using 1 x modem (candidates: 1) 22:59:23.681870 tst register_a5_3_authreq.py:8: start network... 22:59:23.905163 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:59:24.417170 run create_hlr_db(pid=25111): Launched 22:59:24.551496 bus /sierra_2: Setting Powered False 22:59:25.616304 run create_hlr_db(pid=25111): Terminated: ok {rc=0} 22:59:26.057097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25113): Launched 22:59:26.367394 run osmo-hlr_10.42.42.2(pid=25114): Launched 22:59:26.485681 run osmo-stp_10.42.42.5: Starting osmo-stp 22:59:27.036563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25116): Launched 22:59:27.347701 run osmo-stp_10.42.42.5(pid=25117): Launched 22:59:27.466336 run osmo-msc_10.42.42.6: Starting osmo-msc 22:59:28.026931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25119): Launched 22:59:28.337438 run osmo-msc_10.42.42.6(pid=25120): Launched 22:59:28.511185 run osmo-stp_10.42.42.5(pid=25117): ERR: Terminated: ERROR {rc=1} [trial-2350↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25117)] 22:59:28.644280 run osmo-stp_10.42.42.5(pid=25117): stdout: | (launched: 2022-12-08_22:59:27.291365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:28.777448 run osmo-stp_10.42.42.5(pid=25117): stderr: | 20221208225927462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225927462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225927463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225927463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225927463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225927463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225927464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:28.909218 run osmo-stp_10.42.42.5(pid=25117): stdout: | (launched: 2022-12-08_22:59:27.291365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:29.033942 run osmo-stp_10.42.42.5(pid=25117): stderr: | 20221208225927462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208225927462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208225927463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208225927463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208225927463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208225927463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208225927464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:29.183480 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25117): Process ended prematurely: osmo-stp_10.42.42.5(pid=25117) [trial-2350↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25117)] [trial-2350↪encryption↪register_a5_3_authreq.py:8] 22:59:29.192807 tst register_a5_3_authreq.py:8: Test FAILED (6.3 sec) 22:59:29.219925 run osmo-hlr_10.42.42.2(pid=25114): ERR: Terminated: ERROR {rc=237} [trial-2350↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25114)] 22:59:29.269159 run osmo-hlr_10.42.42.2(pid=25114): stdout: | (launched: 2022-12-08_22:59:26.311387) 22:59:29.319536 run osmo-hlr_10.42.42.2(pid=25114): stderr: | 20221208225926490 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208225926490 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208225926490 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208225926490 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208225926490 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208225926490 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208225926502 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208225926511 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208225926511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208225926511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:59:29.390078 run osmo-msc_10.42.42.6(pid=25120): ERR: Terminated: ERROR {rc=2} [trial-2350↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25120)] 22:59:29.438650 run osmo-msc_10.42.42.6(pid=25120): stdout: | (launched: 2022-12-08_22:59:28.281204) 22:59:29.488877 run osmo-msc_10.42.42.6(pid=25120): stderr: | 20221208225928551 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208225928551 DLGLOBAL DEBUG validating counter group 0x7fa3aecefc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208225928551 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208225928551 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208225928551 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208225928552 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208225928553 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208225928554 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208225928554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208225928554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:59:29.539654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25113): Terminating (SIGTERM) 22:59:29.579731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25116): Terminating (SIGTERM) 22:59:29.620652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25119): Terminating (SIGTERM) 22:59:29.661300 --- ParallelTerminationStrategy: PID 25113 died... 22:59:29.680386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25113): Terminated: ok {rc=0} 22:59:29.725522 --- ParallelTerminationStrategy: PID 25116 died... 22:59:29.744056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25116): Terminated: ok {rc=0} 22:59:29.789277 --- ParallelTerminationStrategy: PID 25119 died... 22:59:29.807912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25119): Terminated: ok {rc=0} 22:59:29.892852 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 22:59:31.121051 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:59:31.126074 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 22:59:31.146260 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 22:59:31.175977 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 22:59:31.204000 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 22:59:31.224610 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 22:59:31.256140 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 22:59:31.756874 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2350 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 22:59:31.763418 tst handover.py:11: TEST_CONFIG: {} 22:59:31.982868 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 22:59:31.999400 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 22:59:32.024150 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 22:59:32.077239 tst handover.py: using MSISDN 6900 22:59:32.217328 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6900', subscriber_id=0} 22:59:32.328588 run srsepc_10.42.42.118: Starting srsepc 22:59:34.171597 run rm-remote-dir(pid=25125): Launched 22:59:34.294358 bus /sierra_2: Setting Powered False 22:59:35.360617 run rm-remote-dir(pid=25125): Terminated: ok {rc=0} 22:59:35.827168 run mk-remote-dir(pid=25126): Launched 22:59:37.020515 run mk-remote-dir(pid=25126): Terminated: ok {rc=0} 22:59:37.334871 run scp-inst-to-remote(pid=25127): Launched 22:59:39.527429 run scp-inst-to-remote(pid=25127): Terminated: ok {rc=0} 22:59:39.886502 run rm-remote-dir(pid=25129): Launched 22:59:41.078083 run rm-remote-dir(pid=25129): Terminated: ok {rc=0} 22:59:41.439514 run mk-remote-dir(pid=25130): Launched 22:59:42.631737 run mk-remote-dir(pid=25130): Terminated: ok {rc=0} 22:59:42.939744 run scp-cfg-to-remote(pid=25131): Launched 22:59:44.128938 run scp-cfg-to-remote(pid=25131): Terminated: ok {rc=0} 22:59:44.435577 run scp-db-to-remote(pid=25133): Launched 22:59:45.625990 run scp-db-to-remote(pid=25133): Terminated: ok {rc=0} 22:59:45.767510 run srsepc_10.42.42.118: Setting RPATH for srsepc 22:59:46.125887 run patchelf(pid=25135): Launched 22:59:47.346727 run patchelf(pid=25135): Terminated: ok {rc=0} 22:59:47.488506 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 22:59:47.821599 run setcap-netadm(pid=25136): Launched 22:59:49.011900 run setcap-netadm(pid=25136): Terminated: ok {rc=0} 22:59:49.360275 run srsepc(pid=25137): Launched 22:59:49.483077 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 22:59:50.669960 run rm-remote-dir(pid=25138): Launched 22:59:50.858732 run srsepc(pid=25137): ERR: Terminated: ERROR {rc=127} [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25137)] 22:59:51.003547 run srsepc(pid=25137): stdout: | (launched: 2022-12-08_22:59:49.300319) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 22:59:51.149346 run srsepc(pid=25137): stderr: | (launched: 2022-12-08_22:59:49.349929) | Connection to 10.42.42.116 closed. 22:59:51.294914 run srsepc(pid=25137): stdout: | (launched: 2022-12-08_22:59:49.300319) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 22:59:51.435135 run srsepc(pid=25137): stderr: | (launched: 2022-12-08_22:59:49.349929) | Connection to 10.42.42.116 closed. 22:59:51.601320 run rm-remote-dir(pid=25138): Terminating (SIGINT) 22:59:51.792434 run rm-remote-dir(pid=25138): Terminated: ok {rc=0} 22:59:51.930312 tst handover.py:37: ERR: Error: srsepc(pid=25137): Process ended prematurely: srsepc(pid=25137) [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25137)] [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 22:59:51.940800 tst handover.py:37: Test FAILED (20.2 sec) 22:59:52.022087 run scp-back-log(pid=25139): Launched 22:59:53.103439 run scp-back-log(pid=25139): ERR: Terminated: ERROR {rc=1} [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=25139)] 22:59:53.168744 run scp-back-log(pid=25139): stdout: | (launched: 2022-12-08_22:59:51.990772) 22:59:53.235589 run scp-back-log(pid=25139): stderr: | (launched: 2022-12-08_22:59:52.011728) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 22:59:53.310591 tst srsepc_10.42.42.118: Error('scp-back-log(pid=25139): launch_sync(): local process exited with status 1 [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=25139)]') ---------------------------------------------- trial-2350 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 22:59:53.360817 tst iperf3_bidir.py:13: Number of physical ue: 1 22:59:53.583943 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 22:59:53.627078 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 22:59:53.848867 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 22:59:53.865066 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 22:59:53.898136 tst iperf3_bidir.py: using MSISDN 6901 22:59:54.018450 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6901', subscriber_id=0} 22:59:54.134307 run srsepc_10.42.42.118: Starting srsepc 22:59:54.811112 run rm-remote-dir(pid=25141): Launched 22:59:56.003152 run rm-remote-dir(pid=25141): Terminated: ok {rc=0} 22:59:56.364825 run mk-remote-dir(pid=25142): Launched 22:59:57.556381 run mk-remote-dir(pid=25142): Terminated: ok {rc=0} 22:59:57.863957 run scp-inst-to-remote(pid=25143): Launched 23:00:00.053984 run scp-inst-to-remote(pid=25143): Terminated: ok {rc=0} 23:00:00.414543 run rm-remote-dir(pid=25145): Launched 23:00:01.604057 run rm-remote-dir(pid=25145): Terminated: ok {rc=0} 23:00:01.969391 run mk-remote-dir(pid=25146): Launched 23:00:03.252164 run mk-remote-dir(pid=25146): Terminated: ok {rc=0} 23:00:03.560531 run scp-cfg-to-remote(pid=25150): Launched 23:00:04.750528 run scp-cfg-to-remote(pid=25150): Terminated: ok {rc=0} 23:00:05.056420 run scp-db-to-remote(pid=25152): Launched 23:00:06.246422 run scp-db-to-remote(pid=25152): Terminated: ok {rc=0} 23:00:06.388576 run srsepc_10.42.42.118: Setting RPATH for srsepc 23:00:06.721537 run patchelf(pid=25154): Launched 23:00:07.911114 run patchelf(pid=25154): Terminated: ok {rc=0} 23:00:08.052691 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 23:00:08.385993 run setcap-netadm(pid=25155): Launched 23:00:09.575627 run setcap-netadm(pid=25155): Terminated: ok {rc=0} 23:00:09.923921 run srsepc(pid=25156): Launched 23:00:10.047270 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 23:00:11.235695 run rm-remote-dir(pid=25157): Launched 23:00:11.424382 run srsepc(pid=25156): ERR: Terminated: ERROR {rc=127} [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25156)] 23:00:11.569013 run srsepc(pid=25156): stdout: | (launched: 2022-12-08_23:00:09.863877) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:00:11.714867 run srsepc(pid=25156): stderr: | (launched: 2022-12-08_23:00:09.913480) | Connection to 10.42.42.116 closed. 23:00:11.860578 run srsepc(pid=25156): stdout: | (launched: 2022-12-08_23:00:09.863877) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:00:12.000776 run srsepc(pid=25156): stderr: | (launched: 2022-12-08_23:00:09.913480) | Connection to 10.42.42.116 closed. 23:00:12.166970 run rm-remote-dir(pid=25157): Terminating (SIGINT) 23:00:12.358826 run rm-remote-dir(pid=25157): Terminated: ok {rc=0} 23:00:12.497195 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=25156): Process ended prematurely: srsepc(pid=25156) [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25156)] [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 23:00:12.508152 tst iperf3_bidir.py:42: Test FAILED (19.1 sec) 23:00:12.590462 run scp-back-log(pid=25158): Launched 23:00:13.673221 run scp-back-log(pid=25158): ERR: Terminated: ERROR {rc=1} [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=25158)] 23:00:13.739290 run scp-back-log(pid=25158): stdout: | (launched: 2022-12-08_23:00:12.558141) 23:00:13.806568 run scp-back-log(pid=25158): stderr: | (launched: 2022-12-08_23:00:12.579307) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 23:00:13.882208 tst srsepc_10.42.42.118: Error('scp-back-log(pid=25158): launch_sync(): local process exited with status 1 [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=25158)]') ---------------------------------------------- trial-2350 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 23:00:13.932848 tst iperf3_dl.py:13: Number of physical ue: 1 23:00:14.156934 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 23:00:14.201972 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 23:00:14.407372 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 23:00:14.423294 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 23:00:14.455541 tst iperf3_dl.py: using MSISDN 6902 23:00:14.577232 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6902', subscriber_id=0} 23:00:14.693817 run srsepc_10.42.42.118: Starting srsepc 23:00:15.368268 run rm-remote-dir(pid=25160): Launched 23:00:16.558382 run rm-remote-dir(pid=25160): Terminated: ok {rc=0} 23:00:16.931762 run mk-remote-dir(pid=25161): Launched 23:00:18.183649 run mk-remote-dir(pid=25161): Terminated: ok {rc=0} 23:00:18.491350 run scp-inst-to-remote(pid=25162): Launched 23:00:20.682666 run scp-inst-to-remote(pid=25162): Terminated: ok {rc=0} 23:00:21.041985 run rm-remote-dir(pid=25164): Launched 23:00:22.233383 run rm-remote-dir(pid=25164): Terminated: ok {rc=0} 23:00:22.594603 run mk-remote-dir(pid=25165): Launched 23:00:23.786937 run mk-remote-dir(pid=25165): Terminated: ok {rc=0} 23:00:24.094097 run scp-cfg-to-remote(pid=25166): Launched 23:00:25.283441 run scp-cfg-to-remote(pid=25166): Terminated: ok {rc=0} 23:00:25.590050 run scp-db-to-remote(pid=25168): Launched 23:00:26.780864 run scp-db-to-remote(pid=25168): Terminated: ok {rc=0} 23:00:26.923100 run srsepc_10.42.42.118: Setting RPATH for srsepc 23:00:27.256799 run patchelf(pid=25170): Launched 23:00:28.446649 run patchelf(pid=25170): Terminated: ok {rc=0} 23:00:28.588902 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 23:00:28.922128 run setcap-netadm(pid=25171): Launched 23:00:30.111955 run setcap-netadm(pid=25171): Terminated: ok {rc=0} 23:00:30.461162 run srsepc(pid=25172): Launched 23:00:30.583611 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 23:00:31.849739 run rm-remote-dir(pid=25173): Launched 23:00:32.156085 run srsepc(pid=25172): ERR: Terminated: ERROR {rc=127} [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25172)] 23:00:32.302306 run srsepc(pid=25172): stdout: | (launched: 2022-12-08_23:00:30.401321) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:00:32.447994 run srsepc(pid=25172): stderr: | (launched: 2022-12-08_23:00:30.450639) | Connection to 10.42.42.116 closed. 23:00:32.593630 run srsepc(pid=25172): stdout: | (launched: 2022-12-08_23:00:30.401321) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:00:32.734078 run srsepc(pid=25172): stderr: | (launched: 2022-12-08_23:00:30.450639) | Connection to 10.42.42.116 closed. 23:00:32.900925 run rm-remote-dir(pid=25173): Terminating (SIGINT) 23:00:33.091891 run rm-remote-dir(pid=25173): Terminated: ok {rc=0} 23:00:33.230642 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=25172): Process ended prematurely: srsepc(pid=25172) [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25172)] [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 23:00:33.241475 tst iperf3_dl.py:42: Test FAILED (19.3 sec) 23:00:33.323707 run scp-back-log(pid=25174): Launched 23:00:34.405109 run scp-back-log(pid=25174): ERR: Terminated: ERROR {rc=1} [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=25174)] 23:00:34.470836 run scp-back-log(pid=25174): stdout: | (launched: 2022-12-08_23:00:33.292022) 23:00:34.538092 run scp-back-log(pid=25174): stderr: | (launched: 2022-12-08_23:00:33.313263) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 23:00:34.613581 tst srsepc_10.42.42.118: Error('scp-back-log(pid=25174): launch_sync(): local process exited with status 1 [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=25174)]') ---------------------------------------------- trial-2350 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 23:00:34.663960 tst iperf3_ul.py:13: Number of physical ue: 1 23:00:34.887673 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 23:00:34.930882 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 23:00:35.153049 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 23:00:35.169359 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 23:00:35.203643 tst iperf3_ul.py: using MSISDN 6903 23:00:35.323592 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6903', subscriber_id=0} 23:00:35.439315 run srsepc_10.42.42.118: Starting srsepc 23:00:36.113902 run rm-remote-dir(pid=25176): Launched 23:00:37.306541 run rm-remote-dir(pid=25176): Terminated: ok {rc=0} 23:00:37.668359 run mk-remote-dir(pid=25177): Launched 23:00:38.861199 run mk-remote-dir(pid=25177): Terminated: ok {rc=0} 23:00:39.168686 run scp-inst-to-remote(pid=25178): Launched 23:00:41.360939 run scp-inst-to-remote(pid=25178): Terminated: ok {rc=0} 23:00:41.720349 run rm-remote-dir(pid=25180): Launched 23:00:42.912522 run rm-remote-dir(pid=25180): Terminated: ok {rc=0} 23:00:43.274693 run mk-remote-dir(pid=25181): Launched 23:00:44.466854 run mk-remote-dir(pid=25181): Terminated: ok {rc=0} 23:00:44.774398 run scp-cfg-to-remote(pid=25182): Launched 23:00:45.976915 run scp-cfg-to-remote(pid=25182): Terminated: ok {rc=0} 23:00:46.285901 run scp-db-to-remote(pid=25184): Launched 23:00:47.536125 run scp-db-to-remote(pid=25184): Terminated: ok {rc=0} 23:00:47.669618 run srsepc_10.42.42.118: Setting RPATH for srsepc 23:00:47.980685 run patchelf(pid=25186): Launched 23:00:49.159631 run patchelf(pid=25186): Terminated: ok {rc=0} 23:00:49.292496 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 23:00:49.603938 run setcap-netadm(pid=25187): Launched 23:00:50.783277 run setcap-netadm(pid=25187): Terminated: ok {rc=0} 23:00:51.110667 run srsepc(pid=25188): Launched 23:00:51.227004 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 23:00:52.341493 run rm-remote-dir(pid=25189): Launched 23:00:52.521623 run srsepc(pid=25188): ERR: Terminated: ERROR {rc=127} [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25188)] 23:00:52.659609 run srsepc(pid=25188): stdout: | (launched: 2022-12-08_23:00:51.054127) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:00:52.797309 run srsepc(pid=25188): stderr: | (launched: 2022-12-08_23:00:51.100200) | Connection to 10.42.42.116 closed. 23:00:52.935008 run srsepc(pid=25188): stdout: | (launched: 2022-12-08_23:00:51.054127) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:00:53.066989 run srsepc(pid=25188): stderr: | (launched: 2022-12-08_23:00:51.100200) | Connection to 10.42.42.116 closed. 23:00:53.223158 run rm-remote-dir(pid=25189): Terminating (SIGINT) 23:00:53.403650 run rm-remote-dir(pid=25189): Terminated: ok {rc=0} 23:00:53.534184 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=25188): Process ended prematurely: srsepc(pid=25188) [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25188)] [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 23:00:53.544190 tst iperf3_ul.py:42: Test FAILED (18.9 sec) 23:00:53.621515 run scp-back-log(pid=25190): Launched 23:00:54.700008 run scp-back-log(pid=25190): ERR: Terminated: ERROR {rc=1} [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=25190)] 23:00:54.762463 run scp-back-log(pid=25190): stdout: | (launched: 2022-12-08_23:00:53.591177) 23:00:54.826704 run scp-back-log(pid=25190): stderr: | (launched: 2022-12-08_23:00:53.611298) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 23:00:54.898803 tst srsepc_10.42.42.118: Error('scp-back-log(pid=25190): launch_sync(): local process exited with status 1 [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=25190)]') ---------------------------------------------- trial-2350 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 23:00:54.945838 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 23:00:54.962234 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 23:00:54.984592 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 23:00:55.034483 tst ping.py: using MSISDN 6904 23:00:55.158132 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6904', subscriber_id=0} 23:00:55.275313 run srsepc_10.42.42.118: Starting srsepc 23:00:55.952182 run rm-remote-dir(pid=25192): Launched 23:00:57.143871 run rm-remote-dir(pid=25192): Terminated: ok {rc=0} 23:00:57.505218 run mk-remote-dir(pid=25193): Launched 23:00:58.695735 run mk-remote-dir(pid=25193): Terminated: ok {rc=0} 23:00:59.003259 run scp-inst-to-remote(pid=25194): Launched 23:01:01.215152 run scp-inst-to-remote(pid=25194): Terminated: ok {rc=0} 23:01:01.617781 run rm-remote-dir(pid=25196): Launched 23:01:02.828570 run rm-remote-dir(pid=25196): Terminated: ok {rc=0} 23:01:03.168746 run mk-remote-dir(pid=25197): Launched 23:01:04.350184 run mk-remote-dir(pid=25197): Terminated: ok {rc=0} 23:01:04.637737 run scp-cfg-to-remote(pid=25198): Launched 23:01:05.815849 run scp-cfg-to-remote(pid=25198): Terminated: ok {rc=0} 23:01:06.102562 run scp-db-to-remote(pid=25200): Launched 23:01:07.283118 run scp-db-to-remote(pid=25200): Terminated: ok {rc=0} 23:01:07.415974 run srsepc_10.42.42.118: Setting RPATH for srsepc 23:01:07.726868 run patchelf(pid=25202): Launched 23:01:08.905928 run patchelf(pid=25202): Terminated: ok {rc=0} 23:01:09.038720 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 23:01:09.349386 run setcap-netadm(pid=25203): Launched 23:01:10.529267 run setcap-netadm(pid=25203): Terminated: ok {rc=0} 23:01:10.854118 run srsepc(pid=25204): Launched 23:01:10.969969 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 23:01:12.091155 run rm-remote-dir(pid=25205): Launched 23:01:12.270841 run srsepc(pid=25204): ERR: Terminated: ERROR {rc=127} [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25204)] 23:01:12.408368 run srsepc(pid=25204): stdout: | (launched: 2022-12-08_23:01:10.798137) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:01:12.545864 run srsepc(pid=25204): stderr: | (launched: 2022-12-08_23:01:10.844117) | Connection to 10.42.42.116 closed. 23:01:12.682883 run srsepc(pid=25204): stdout: | (launched: 2022-12-08_23:01:10.798137) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:01:12.814383 run srsepc(pid=25204): stderr: | (launched: 2022-12-08_23:01:10.844117) | Connection to 10.42.42.116 closed. 23:01:12.970002 run rm-remote-dir(pid=25205): Terminating (SIGINT) 23:01:13.149977 run rm-remote-dir(pid=25205): Terminated: ok {rc=0} 23:01:13.280008 tst ping.py:16: ERR: Error: srsepc(pid=25204): Process ended prematurely: srsepc(pid=25204) [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25204)] [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 23:01:13.290234 tst ping.py:16: Test FAILED (18.3 sec) 23:01:13.367738 run scp-back-log(pid=25206): Launched 23:01:14.445895 run scp-back-log(pid=25206): ERR: Terminated: ERROR {rc=1} [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=25206)] 23:01:14.508188 run scp-back-log(pid=25206): stdout: | (launched: 2022-12-08_23:01:13.337410) 23:01:14.571974 run scp-back-log(pid=25206): stderr: | (launched: 2022-12-08_23:01:13.357473) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 23:01:14.644724 tst srsepc_10.42.42.118: Error('scp-back-log(pid=25206): launch_sync(): local process exited with status 1 [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=25206)]') ---------------------------------------------- trial-2350 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 23:01:14.691263 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 23:01:14.707646 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 23:01:14.730182 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 23:01:14.779082 tst rrc_idle_mo_ping.py: using MSISDN 6905 23:01:14.894773 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6905', subscriber_id=0} 23:01:15.003068 run srsepc_10.42.42.118: Starting srsepc 23:01:15.636791 run rm-remote-dir(pid=25208): Launched 23:01:16.817358 run rm-remote-dir(pid=25208): Terminated: ok {rc=0} 23:01:17.166115 run mk-remote-dir(pid=25209): Launched 23:01:18.390860 run mk-remote-dir(pid=25209): Terminated: ok {rc=0} 23:01:18.697809 run scp-inst-to-remote(pid=25210): Launched 23:01:20.889572 run scp-inst-to-remote(pid=25210): Terminated: ok {rc=0} 23:01:21.249672 run rm-remote-dir(pid=25212): Launched 23:01:22.440444 run rm-remote-dir(pid=25212): Terminated: ok {rc=0} 23:01:22.801349 run mk-remote-dir(pid=25213): Launched 23:01:23.994621 run mk-remote-dir(pid=25213): Terminated: ok {rc=0} 23:01:24.302348 run scp-cfg-to-remote(pid=25214): Launched 23:01:25.490951 run scp-cfg-to-remote(pid=25214): Terminated: ok {rc=0} 23:01:25.796489 run scp-db-to-remote(pid=25216): Launched 23:01:26.986523 run scp-db-to-remote(pid=25216): Terminated: ok {rc=0} 23:01:27.128024 run srsepc_10.42.42.118: Setting RPATH for srsepc 23:01:27.460777 run patchelf(pid=25218): Launched 23:01:28.650331 run patchelf(pid=25218): Terminated: ok {rc=0} 23:01:28.791875 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 23:01:29.123809 run setcap-netadm(pid=25219): Launched 23:01:30.314367 run setcap-netadm(pid=25219): Terminated: ok {rc=0} 23:01:30.662084 run srsepc(pid=25220): Launched 23:01:30.784413 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 23:01:32.087844 run rm-remote-dir(pid=25221): Launched 23:01:32.321961 run srsepc(pid=25220): ERR: Terminated: ERROR {rc=127} [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25220)] 23:01:32.466464 run srsepc(pid=25220): stdout: | (launched: 2022-12-08_23:01:30.602505) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:01:32.611772 run srsepc(pid=25220): stderr: | (launched: 2022-12-08_23:01:30.651686) | Connection to 10.42.42.116 closed. 23:01:32.757385 run srsepc(pid=25220): stdout: | (launched: 2022-12-08_23:01:30.602505) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:01:32.897383 run srsepc(pid=25220): stderr: | (launched: 2022-12-08_23:01:30.651686) | Connection to 10.42.42.116 closed. 23:01:33.063342 run rm-remote-dir(pid=25221): Terminating (SIGINT) 23:01:33.255387 run rm-remote-dir(pid=25221): Terminated: ok {rc=0} 23:01:33.393704 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=25220): Process ended prematurely: srsepc(pid=25220) [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25220)] [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 23:01:33.404489 tst rrc_idle_mo_ping.py:16: Test FAILED (18.7 sec) 23:01:33.487019 run scp-back-log(pid=25222): Launched 23:01:34.568765 run scp-back-log(pid=25222): ERR: Terminated: ERROR {rc=1} [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=25222)] 23:01:34.634258 run scp-back-log(pid=25222): stdout: | (launched: 2022-12-08_23:01:33.455169) 23:01:34.701331 run scp-back-log(pid=25222): stderr: | (launched: 2022-12-08_23:01:33.476461) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 23:01:34.776627 tst srsepc_10.42.42.118: Error('scp-back-log(pid=25222): launch_sync(): local process exited with status 1 [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=25222)]') ---------------------------------------------- trial-2350 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 23:01:34.827813 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 23:01:34.844847 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 23:01:34.869433 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 23:01:34.918148 tst rrc_idle_mt_ping.py: using MSISDN 6906 23:01:35.040767 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6906', subscriber_id=0} 23:01:35.156348 run srsepc_10.42.42.118: Starting srsepc 23:01:35.832280 run rm-remote-dir(pid=25224): Launched 23:01:37.024110 run rm-remote-dir(pid=25224): Terminated: ok {rc=0} 23:01:37.387096 run mk-remote-dir(pid=25225): Launched 23:01:38.578632 run mk-remote-dir(pid=25225): Terminated: ok {rc=0} 23:01:38.887759 run scp-inst-to-remote(pid=25226): Launched 23:01:41.078040 run scp-inst-to-remote(pid=25226): Terminated: ok {rc=0} 23:01:41.439412 run rm-remote-dir(pid=25228): Launched 23:01:42.630715 run rm-remote-dir(pid=25228): Terminated: ok {rc=0} 23:01:42.992769 run mk-remote-dir(pid=25229): Launched 23:01:44.175458 run mk-remote-dir(pid=25229): Terminated: ok {rc=0} 23:01:44.465311 run scp-cfg-to-remote(pid=25230): Launched 23:01:45.645236 run scp-cfg-to-remote(pid=25230): Terminated: ok {rc=0} 23:01:45.941772 run scp-db-to-remote(pid=25232): Launched 23:01:47.187236 run scp-db-to-remote(pid=25232): Terminated: ok {rc=0} 23:01:47.324300 run srsepc_10.42.42.118: Setting RPATH for srsepc 23:01:47.637525 run patchelf(pid=25234): Launched 23:01:48.816479 run patchelf(pid=25234): Terminated: ok {rc=0} 23:01:48.950187 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 23:01:49.262833 run setcap-netadm(pid=25235): Launched 23:01:50.442907 run setcap-netadm(pid=25235): Terminated: ok {rc=0} 23:01:50.769720 run srsepc(pid=25236): Launched 23:01:50.887123 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 23:01:52.013307 run rm-remote-dir(pid=25237): Launched 23:01:52.192294 run srsepc(pid=25236): ERR: Terminated: ERROR {rc=127} [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25236)] 23:01:52.329953 run srsepc(pid=25236): stdout: | (launched: 2022-12-08_23:01:50.713524) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:01:52.466713 run srsepc(pid=25236): stderr: | (launched: 2022-12-08_23:01:50.759755) | Connection to 10.42.42.116 closed. 23:01:52.603900 run srsepc(pid=25236): stdout: | (launched: 2022-12-08_23:01:50.713524) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:01:52.735248 run srsepc(pid=25236): stderr: | (launched: 2022-12-08_23:01:50.759755) | Connection to 10.42.42.116 closed. 23:01:52.891021 run rm-remote-dir(pid=25237): Terminating (SIGINT) 23:01:53.071191 run rm-remote-dir(pid=25237): Terminated: ok {rc=0} 23:01:53.201590 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=25236): Process ended prematurely: srsepc(pid=25236) [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25236)] [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 23:01:53.211598 tst rrc_idle_mt_ping.py:16: Test FAILED (18.4 sec) 23:01:53.288626 run scp-back-log(pid=25238): Launched 23:01:54.367085 run scp-back-log(pid=25238): ERR: Terminated: ERROR {rc=1} [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=25238)] 23:01:54.429297 run scp-back-log(pid=25238): stdout: | (launched: 2022-12-08_23:01:53.258454) 23:01:54.492663 run scp-back-log(pid=25238): stderr: | (launched: 2022-12-08_23:01:53.278585) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 23:01:54.563922 tst srsepc_10.42.42.118: Error('scp-back-log(pid=25238): launch_sync(): local process exited with status 1 [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=25238)]') --------------------------------------------------------------------- trial-2350 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 23:01:54.691535 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:01:54.696474 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 23:01:54.736750 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 23:01:54.762932 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 23:01:54.814165 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 23:01:54.856763 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 23:01:54.882688 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 23:01:55.429813 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 23:01:55.434977 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 23:01:55.445767 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 23:01:55.491572 tst handover.py: using LAC 17343 23:01:55.621830 tst handover.py: using RAC 3 23:01:55.742219 tst handover.py: using CellId 17343 23:01:55.872807 tst handover.py: using BVCI 17344 23:01:55.992055 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 23:01:56.028658 tst handover.py: using LAC 17344 23:01:56.157967 tst handover.py: using RAC 4 23:01:56.286328 tst handover.py: using CellId 17344 23:01:56.416116 tst handover.py: using BVCI 17345 23:01:56.535902 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 23:01:56.547107 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 23:01:56.558172 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 23:01:56.569472 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 23:01:56.580848 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 23:01:56.592087 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 23:01:56.708167 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 23:01:56.827503 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:01:57.331920 run create_hlr_db(pid=25246): Launched 23:01:58.522905 run create_hlr_db(pid=25246): Terminated: ok {rc=0} 23:01:58.866060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25248): Launched 23:01:59.189737 run osmo-hlr_10.42.42.2(pid=25249): Launched 23:01:59.313815 run osmo-stp_10.42.42.5: Starting osmo-stp 23:01:59.878249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25251): Launched 23:02:00.202631 run osmo-stp_10.42.42.5(pid=25252): Launched 23:02:00.327325 run osmo-msc_10.42.42.6: Starting osmo-msc 23:02:00.945754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25254): Launched 23:02:01.283332 run osmo-msc_10.42.42.6(pid=25255): Launched 23:02:01.565849 run osmo-stp_10.42.42.5(pid=25252): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25252)] 23:02:01.844274 run osmo-stp_10.42.42.5(pid=25252): stdout: | (launched: 2022-12-08_23:02:00.143971) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:02.184515 run osmo-stp_10.42.42.5(pid=25252): stderr: | 20221208230200334 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230200334 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230200334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230200335 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230200335 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230200335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230200335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:02.413548 run osmo-stp_10.42.42.5(pid=25252): stdout: | (launched: 2022-12-08_23:02:00.143971) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:02.542872 run osmo-stp_10.42.42.5(pid=25252): stderr: | 20221208230200334 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230200334 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230200334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230200335 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230200335 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230200335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230200335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:02.697716 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25252): Process ended prematurely: osmo-stp_10.42.42.5(pid=25252) [trial-2350↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25252)] [trial-2350↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 23:02:02.706614 tst handover.py:18: Test FAILED (7.3 sec) 23:02:02.734377 run osmo-hlr_10.42.42.2(pid=25249): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25249)] 23:02:02.785199 run osmo-hlr_10.42.42.2(pid=25249): stdout: | (launched: 2022-12-08_23:01:59.131521) 23:02:02.837673 run osmo-hlr_10.42.42.2(pid=25249): stderr: | 20221208230159329 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230159329 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230159329 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230159329 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230159329 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230159329 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230159342 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230159350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230159351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230159351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:02:02.910943 run osmo-msc_10.42.42.6(pid=25255): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25255)] 23:02:02.961830 run osmo-msc_10.42.42.6(pid=25255): stdout: | (launched: 2022-12-08_23:02:01.219195) 23:02:03.014263 run osmo-msc_10.42.42.6(pid=25255): stderr: | 20221208230201858 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230201858 DLGLOBAL DEBUG validating counter group 0x7f73348bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230201858 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230201859 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230201860 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230201860 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230201867 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230201869 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230201870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230201870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:02:03.066819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25248): Terminating (SIGTERM) 23:02:03.109069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25251): Terminating (SIGTERM) 23:02:03.151284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25254): Terminating (SIGTERM) 23:02:03.194195 --- ParallelTerminationStrategy: PID 25248 died... 23:02:03.214092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25248): Terminated: ok {rc=0} 23:02:03.261259 --- ParallelTerminationStrategy: PID 25251 died... 23:02:03.280854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25251): Terminated: ok {rc=0} 23:02:03.327681 --- ParallelTerminationStrategy: PID 25254 died... 23:02:03.347327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25254): Terminated: ok {rc=0} 23:02:03.435608 bus /sierra_3: Setting Powered False 23:02:04.534573 bus /sierra_3: Setting Powered False 23:02:05.651120 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 23:02:06.895808 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:02:06.900686 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 23:02:06.940117 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 23:02:06.966532 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 23:02:07.019017 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 23:02:07.058320 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 23:02:07.084367 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 23:02:07.634741 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 23:02:07.639871 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:02:07.650589 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 23:02:07.687927 tst handover.py: using LAC 17345 23:02:07.808865 tst handover.py: using RAC 5 23:02:07.935655 tst handover.py: using CellId 17345 23:02:08.056016 tst handover.py: using BVCI 17346 23:02:08.167421 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 23:02:08.200318 tst handover.py: using LAC 17346 23:02:08.328121 tst handover.py: using RAC 6 23:02:08.456561 tst handover.py: using CellId 17346 23:02:08.582579 tst handover.py: using BVCI 17347 23:02:08.697090 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:02:08.707801 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:02:08.718372 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:02:08.729150 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:02:08.740013 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:02:08.750852 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 23:02:08.867036 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 23:02:08.986132 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:02:09.432482 run create_hlr_db(pid=25261): Launched 23:02:09.549407 bus /sierra_2: Setting Powered False 23:02:10.610734 run create_hlr_db(pid=25261): Terminated: ok {rc=0} 23:02:11.010608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25264): Launched 23:02:11.315062 run osmo-hlr_10.42.42.2(pid=25265): Launched 23:02:11.431352 run osmo-stp_10.42.42.5: Starting osmo-stp 23:02:11.931238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25267): Launched 23:02:12.236423 run osmo-stp_10.42.42.5(pid=25268): Launched 23:02:12.353397 run osmo-msc_10.42.42.6: Starting osmo-msc 23:02:12.879835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25270): Launched 23:02:13.187806 run osmo-msc_10.42.42.6(pid=25271): Launched 23:02:13.359643 run osmo-stp_10.42.42.5(pid=25268): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25268)] 23:02:13.490333 run osmo-stp_10.42.42.5(pid=25268): stdout: | (launched: 2022-12-08_23:02:12.180631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:13.621096 run osmo-stp_10.42.42.5(pid=25268): stderr: | 20221208230212351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230212352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230212352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230212352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230212353 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230212353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230212353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:13.749432 run osmo-stp_10.42.42.5(pid=25268): stdout: | (launched: 2022-12-08_23:02:12.180631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:13.871931 run osmo-stp_10.42.42.5(pid=25268): stderr: | 20221208230212351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230212352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230212352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230212352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230212353 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230212353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230212353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:14.018213 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25268): Process ended prematurely: osmo-stp_10.42.42.5(pid=25268) [trial-2350↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25268)] [trial-2350↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 23:02:14.026456 tst handover.py:18: Test FAILED (6.4 sec) 23:02:14.053268 run osmo-hlr_10.42.42.2(pid=25265): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25265)] 23:02:14.102205 run osmo-hlr_10.42.42.2(pid=25265): stdout: | (launched: 2022-12-08_23:02:11.259977) 23:02:14.152591 run osmo-hlr_10.42.42.2(pid=25265): stderr: | 20221208230211437 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230211437 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230211437 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230211437 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230211438 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230211438 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230211462 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230211470 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230211471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230211471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:02:14.222934 run osmo-msc_10.42.42.6(pid=25271): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25271)] 23:02:14.271695 run osmo-msc_10.42.42.6(pid=25271): stdout: | (launched: 2022-12-08_23:02:13.131913) 23:02:14.322003 run osmo-msc_10.42.42.6(pid=25271): stderr: | 20221208230213405 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230213405 DLGLOBAL DEBUG validating counter group 0x7f2a1f86ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230213405 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230213405 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230213406 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230213406 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230213407 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230213408 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230213408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230213408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:02:14.372485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25264): Terminating (SIGTERM) 23:02:14.413033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25267): Terminating (SIGTERM) 23:02:14.453514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25270): Terminating (SIGTERM) 23:02:14.494277 --- ParallelTerminationStrategy: PID 25264 died... 23:02:14.513460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25264): Terminated: ok {rc=0} 23:02:14.558358 --- ParallelTerminationStrategy: PID 25267 died... 23:02:14.577043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25267): Terminated: ok {rc=0} 23:02:14.621885 --- ParallelTerminationStrategy: PID 25270 died... 23:02:14.640592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25270): Terminated: ok {rc=0} 23:02:14.727582 bus /sierra_3: Setting Powered False 23:02:15.827633 bus /sierra_3: Setting Powered False 23:02:16.967312 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 23:02:18.219914 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:02:18.225828 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 23:02:18.281255 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 23:02:18.308503 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 23:02:18.361446 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 23:02:18.415633 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 23:02:18.442691 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 23:02:18.996268 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 23:02:19.002535 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:02:19.014259 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 23:02:19.052181 tst handover.py: using LAC 17347 23:02:19.180494 tst handover.py: using RAC 7 23:02:19.305238 tst handover.py: using CellId 17347 23:02:19.425234 tst handover.py: using BVCI 17348 23:02:19.536148 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 23:02:19.584414 tst handover.py: using LAC 17348 23:02:19.706651 tst handover.py: using RAC 8 23:02:19.827349 tst handover.py: using CellId 17348 23:02:19.949324 tst handover.py: using BVCI 17349 23:02:20.062553 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:02:20.073426 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:02:20.083978 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:02:20.094970 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:02:20.105949 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:02:20.116764 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 23:02:20.235024 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 23:02:20.355975 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:02:20.831210 run create_hlr_db(pid=25276): Launched 23:02:20.963085 bus /sierra_2: Setting Powered False 23:02:22.027849 run create_hlr_db(pid=25276): Terminated: ok {rc=0} 23:02:22.438905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25278): Launched 23:02:22.745187 run osmo-hlr_10.42.42.2(pid=25279): Launched 23:02:22.861721 run osmo-stp_10.42.42.5: Starting osmo-stp 23:02:23.361431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25281): Launched 23:02:23.667880 run osmo-stp_10.42.42.5(pid=25282): Launched 23:02:23.784528 run osmo-msc_10.42.42.6: Starting osmo-msc 23:02:24.323347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25284): Launched 23:02:24.628895 run osmo-msc_10.42.42.6(pid=25285): Launched 23:02:24.800432 run osmo-stp_10.42.42.5(pid=25282): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25282)] 23:02:24.930963 run osmo-stp_10.42.42.5(pid=25282): stdout: | (launched: 2022-12-08_23:02:23.611581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:25.061273 run osmo-stp_10.42.42.5(pid=25282): stderr: | 20221208230223782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230223782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230223782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230223783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230223783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230223783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230223783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:25.189700 run osmo-stp_10.42.42.5(pid=25282): stdout: | (launched: 2022-12-08_23:02:23.611581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:25.312034 run osmo-stp_10.42.42.5(pid=25282): stderr: | 20221208230223782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230223782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230223782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230223783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230223783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230223783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230223783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:25.458298 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25282): Process ended prematurely: osmo-stp_10.42.42.5(pid=25282) [trial-2350↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25282)] [trial-2350↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 23:02:25.466586 tst handover.py:18: Test FAILED (6.5 sec) 23:02:25.493587 run osmo-hlr_10.42.42.2(pid=25279): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25279)] 23:02:25.542602 run osmo-hlr_10.42.42.2(pid=25279): stdout: | (launched: 2022-12-08_23:02:22.688799) 23:02:25.593269 run osmo-hlr_10.42.42.2(pid=25279): stderr: | 20221208230222867 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230222867 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230222867 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230222867 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230222867 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230222867 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230222879 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230222888 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230222888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230222888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:02:25.663654 run osmo-msc_10.42.42.6(pid=25285): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25285)] 23:02:25.712382 run osmo-msc_10.42.42.6(pid=25285): stdout: | (launched: 2022-12-08_23:02:24.573317) 23:02:25.762798 run osmo-msc_10.42.42.6(pid=25285): stderr: | 20221208230224842 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230224843 DLGLOBAL DEBUG validating counter group 0x7f7909182c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230224843 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230224843 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230224843 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230224843 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230224845 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230224845 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230224846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230224846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:02:25.813791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25278): Terminating (SIGTERM) 23:02:25.854260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25281): Terminating (SIGTERM) 23:02:25.894958 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25284): Terminating (SIGTERM) 23:02:25.935812 --- ParallelTerminationStrategy: PID 25278 died... 23:02:25.955036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25278): Terminated: ok {rc=0} 23:02:26.000377 --- ParallelTerminationStrategy: PID 25281 died... 23:02:26.019292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25281): Terminated: ok {rc=0} 23:02:26.064260 --- ParallelTerminationStrategy: PID 25284 died... 23:02:26.083186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25284): Terminated: ok {rc=0} 23:02:26.168279 bus /sierra_3: Setting Powered False 23:02:27.265623 bus /sierra_3: Setting Powered False 23:02:28.382464 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 23:02:29.636778 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:02:29.642051 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 23:02:29.691392 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 23:02:29.717903 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 23:02:29.770349 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 23:02:29.820088 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 23:02:29.846593 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 23:02:30.395223 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 23:02:30.400487 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:02:30.411632 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:02:30.452265 tst handover.py: using LAC 17349 23:02:30.572847 tst handover.py: using RAC 9 23:02:30.696130 tst handover.py: using CellId 17349 23:02:30.816877 tst handover.py: using BVCI 17350 23:02:30.946160 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:02:30.995050 tst handover.py: using LAC 17350 23:02:31.125572 tst handover.py: using RAC 10 23:02:31.247174 tst handover.py: using CellId 17350 23:02:31.371187 tst handover.py: using BVCI 17351 23:02:31.487641 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:02:31.499790 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:02:31.511490 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:02:31.523602 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:02:31.535669 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:02:31.547785 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:02:31.664911 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:02:31.782458 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:02:32.238756 run create_hlr_db(pid=25290): Launched 23:02:32.373559 bus /sierra_2: Setting Powered False 23:02:33.438091 run create_hlr_db(pid=25290): Terminated: ok {rc=0} 23:02:33.848576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25292): Launched 23:02:34.154470 run osmo-hlr_10.42.42.2(pid=25293): Launched 23:02:34.270701 run osmo-stp_10.42.42.5: Starting osmo-stp 23:02:34.787437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25295): Launched 23:02:35.092061 run osmo-stp_10.42.42.5(pid=25296): Launched 23:02:35.208063 run osmo-msc_10.42.42.6: Starting osmo-msc 23:02:35.738315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25299): Launched 23:02:36.044856 run osmo-msc_10.42.42.6(pid=25302): Launched 23:02:36.215944 run osmo-stp_10.42.42.5(pid=25296): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25296)] 23:02:36.346092 run osmo-stp_10.42.42.5(pid=25296): stdout: | (launched: 2022-12-08_23:02:35.036489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:36.476162 run osmo-stp_10.42.42.5(pid=25296): stderr: | 20221208230235207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230235207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230235207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230235208 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230235210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230235210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230235210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:36.604699 run osmo-stp_10.42.42.5(pid=25296): stdout: | (launched: 2022-12-08_23:02:35.036489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:36.727199 run osmo-stp_10.42.42.5(pid=25296): stderr: | 20221208230235207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230235207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230235207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230235208 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230235210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230235210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230235210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:36.873961 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25296): Process ended prematurely: osmo-stp_10.42.42.5(pid=25296) [trial-2350↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25296)] [trial-2350↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 23:02:36.882233 tst handover.py:18: Test FAILED (6.5 sec) 23:02:36.909091 run osmo-hlr_10.42.42.2(pid=25293): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25293)] 23:02:36.957906 run osmo-hlr_10.42.42.2(pid=25293): stdout: | (launched: 2022-12-08_23:02:34.099002) 23:02:37.008544 run osmo-hlr_10.42.42.2(pid=25293): stderr: | 20221208230234277 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230234277 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230234277 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230234277 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230234277 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230234277 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230234290 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230234301 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230234301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230234301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:02:37.078997 run osmo-msc_10.42.42.6(pid=25302): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25302)] 23:02:37.128054 run osmo-msc_10.42.42.6(pid=25302): stdout: | (launched: 2022-12-08_23:02:35.988837) 23:02:37.178631 run osmo-msc_10.42.42.6(pid=25302): stderr: | 20221208230236260 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230236260 DLGLOBAL DEBUG validating counter group 0x7f4f93901c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230236260 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230236260 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230236260 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230236261 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230236262 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230236263 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230236263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230236263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:02:37.229493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25292): Terminating (SIGTERM) 23:02:37.270193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25295): Terminating (SIGTERM) 23:02:37.311078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25299): Terminating (SIGTERM) 23:02:37.352162 --- ParallelTerminationStrategy: PID 25292 died... 23:02:37.371549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25292): Terminated: ok {rc=0} 23:02:37.416752 --- ParallelTerminationStrategy: PID 25295 died... 23:02:37.435716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25295): Terminated: ok {rc=0} 23:02:37.480758 --- ParallelTerminationStrategy: PID 25299 died... 23:02:37.500567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25299): Terminated: ok {rc=0} 23:02:37.586918 bus /sierra_3: Setting Powered False 23:02:38.687873 bus /sierra_3: Setting Powered False 23:02:39.806100 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 23:02:41.059472 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:02:41.064514 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 23:02:41.118015 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:02:41.144317 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 23:02:41.195344 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 23:02:41.248393 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:02:41.274992 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 23:02:41.826703 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 23:02:41.831856 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:02:41.842775 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:02:41.879755 tst handover.py: using LAC 17351 23:02:41.999612 tst handover.py: using RAC 11 23:02:42.122009 tst handover.py: using CellId 17351 23:02:42.242199 tst handover.py: using BVCI 17352 23:02:42.355239 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:02:42.403773 tst handover.py: using LAC 17352 23:02:42.525358 tst handover.py: using RAC 12 23:02:42.644858 tst handover.py: using CellId 17352 23:02:42.769859 tst handover.py: using BVCI 17353 23:02:42.883724 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:02:42.894698 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:02:42.905415 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:02:42.916356 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:02:42.927282 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:02:42.938339 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:02:43.054536 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:02:43.171426 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:02:43.649524 run create_hlr_db(pid=25307): Launched 23:02:43.783111 bus /sierra_2: Setting Powered False 23:02:44.847647 run create_hlr_db(pid=25307): Terminated: ok {rc=0} 23:02:45.256768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25309): Launched 23:02:45.562457 run osmo-hlr_10.42.42.2(pid=25310): Launched 23:02:45.679432 run osmo-stp_10.42.42.5: Starting osmo-stp 23:02:46.214754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25312): Launched 23:02:46.539677 run osmo-stp_10.42.42.5(pid=25313): Launched 23:02:46.717363 run osmo-msc_10.42.42.6: Starting osmo-msc 23:02:47.439245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25315): Launched 23:02:47.743926 run osmo-msc_10.42.42.6(pid=25316): Launched 23:02:47.915760 run osmo-stp_10.42.42.5(pid=25313): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25313)] 23:02:48.046553 run osmo-stp_10.42.42.5(pid=25313): stdout: | (launched: 2022-12-08_23:02:46.480495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:48.176266 run osmo-stp_10.42.42.5(pid=25313): stderr: | 20221208230246822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230246823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230246825 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230246828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230246830 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230246831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230246831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:48.304174 run osmo-stp_10.42.42.5(pid=25313): stdout: | (launched: 2022-12-08_23:02:46.480495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:48.425975 run osmo-stp_10.42.42.5(pid=25313): stderr: | 20221208230246822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230246823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230246825 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230246828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230246830 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230246831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230246831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:48.571649 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25313): Process ended prematurely: osmo-stp_10.42.42.5(pid=25313) [trial-2350↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25313)] [trial-2350↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 23:02:48.579924 tst handover.py:18: Test FAILED (6.7 sec) 23:02:48.606733 run osmo-hlr_10.42.42.2(pid=25310): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25310)] 23:02:48.655417 run osmo-hlr_10.42.42.2(pid=25310): stdout: | (launched: 2022-12-08_23:02:45.506787) 23:02:48.705697 run osmo-hlr_10.42.42.2(pid=25310): stderr: | 20221208230245684 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230245684 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230245684 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230245684 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230245684 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230245684 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230245695 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230245703 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230245703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230245703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:02:48.775854 run osmo-msc_10.42.42.6(pid=25316): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25316)] 23:02:48.824416 run osmo-msc_10.42.42.6(pid=25316): stdout: | (launched: 2022-12-08_23:02:47.688073) 23:02:48.874587 run osmo-msc_10.42.42.6(pid=25316): stderr: | 20221208230247961 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230247961 DLGLOBAL DEBUG validating counter group 0x7fa3bb4b7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230247961 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230247961 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230247961 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230247962 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230247963 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230247964 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230247964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230247964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:02:48.925264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25309): Terminating (SIGTERM) 23:02:48.965638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25312): Terminating (SIGTERM) 23:02:49.006159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25315): Terminating (SIGTERM) 23:02:49.046855 --- ParallelTerminationStrategy: PID 25309 died... 23:02:49.066120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25309): Terminated: ok {rc=0} 23:02:49.111185 --- ParallelTerminationStrategy: PID 25312 died... 23:02:49.129815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25312): Terminated: ok {rc=0} 23:02:49.174667 --- ParallelTerminationStrategy: PID 25315 died... 23:02:49.193352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25315): Terminated: ok {rc=0} 23:02:49.280134 bus /sierra_3: Setting Powered False 23:02:50.380031 bus /sierra_3: Setting Powered False 23:02:51.496579 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 23:02:52.762966 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:02:52.768340 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 23:02:52.810282 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 23:02:52.837511 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 23:02:52.891000 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 23:02:52.933421 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 23:02:52.960469 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 23:02:53.511143 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 23:02:53.516404 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:02:53.527621 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 23:02:53.565998 tst handover.py: using LAC 17353 23:02:53.695305 tst handover.py: using RAC 13 23:02:53.825066 tst handover.py: using CellId 17353 23:02:53.953446 tst handover.py: using BVCI 17354 23:02:54.072197 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 23:02:54.108224 tst handover.py: using LAC 17354 23:02:54.237452 tst handover.py: using RAC 14 23:02:54.365892 tst handover.py: using CellId 17354 23:02:54.493022 tst handover.py: using BVCI 17355 23:02:54.611696 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:02:54.622913 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:02:54.634005 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:02:54.645140 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:02:54.656244 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:02:54.667260 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 23:02:54.781901 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 23:02:54.899622 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:02:55.375847 run create_hlr_db(pid=25321): Launched 23:02:55.507555 bus /sierra_2: Setting Powered False 23:02:56.572608 run create_hlr_db(pid=25321): Terminated: ok {rc=0} 23:02:56.997150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25323): Launched 23:02:57.321641 run osmo-hlr_10.42.42.2(pid=25324): Launched 23:02:57.445283 run osmo-stp_10.42.42.5: Starting osmo-stp 23:02:57.976068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25326): Launched 23:02:58.300270 run osmo-stp_10.42.42.5(pid=25327): Launched 23:02:58.423761 run osmo-msc_10.42.42.6: Starting osmo-msc 23:02:58.983335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25329): Launched 23:02:59.310398 run osmo-msc_10.42.42.6(pid=25330): Launched 23:02:59.491876 run osmo-stp_10.42.42.5(pid=25327): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25327)] 23:02:59.634255 run osmo-stp_10.42.42.5(pid=25327): stdout: | (launched: 2022-12-08_23:02:58.241346) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:59.773086 run osmo-stp_10.42.42.5(pid=25327): stderr: | 20221208230258435 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230258435 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230258436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230258436 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230258437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230258437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230258437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:59.910226 run osmo-stp_10.42.42.5(pid=25327): stdout: | (launched: 2022-12-08_23:02:58.241346) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:00.041051 run osmo-stp_10.42.42.5(pid=25327): stderr: | 20221208230258435 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230258435 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230258436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230258436 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230258437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230258437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230258437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:00.196929 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25327): Process ended prematurely: osmo-stp_10.42.42.5(pid=25327) [trial-2350↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25327)] [trial-2350↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 23:03:00.205994 tst handover.py:18: Test FAILED (6.7 sec) 23:03:00.233823 run osmo-hlr_10.42.42.2(pid=25324): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25324)] 23:03:00.285095 run osmo-hlr_10.42.42.2(pid=25324): stdout: | (launched: 2022-12-08_23:02:57.262449) 23:03:00.337812 run osmo-hlr_10.42.42.2(pid=25324): stderr: | 20221208230257460 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230257460 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230257460 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230257460 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230257460 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230257460 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230257472 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230257480 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230257480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230257480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:03:00.410935 run osmo-msc_10.42.42.6(pid=25330): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25330)] 23:03:00.462048 run osmo-msc_10.42.42.6(pid=25330): stdout: | (launched: 2022-12-08_23:02:59.250868) 23:03:00.514330 run osmo-msc_10.42.42.6(pid=25330): stderr: | 20221208230259572 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230259572 DLGLOBAL DEBUG validating counter group 0x7f08c6dfac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230259572 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230259573 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230259573 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230259573 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230259575 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230259575 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230259575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230259575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:03:00.567024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25323): Terminating (SIGTERM) 23:03:00.609366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25326): Terminating (SIGTERM) 23:03:00.651762 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25329): Terminating (SIGTERM) 23:03:00.694493 --- ParallelTerminationStrategy: PID 25323 died... 23:03:00.714732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25323): Terminated: ok {rc=0} 23:03:00.762111 --- ParallelTerminationStrategy: PID 25326 died... 23:03:00.782035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25326): Terminated: ok {rc=0} 23:03:00.829410 --- ParallelTerminationStrategy: PID 25329 died... 23:03:00.864196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25329): Terminated: ok {rc=0} 23:03:00.976795 bus /sierra_3: Setting Powered False 23:03:02.085709 bus /sierra_3: Setting Powered False 23:03:03.206174 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 23:03:04.450345 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:03:04.455297 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:03:04.508385 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:03:04.534862 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:03:04.587275 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:03:04.640402 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:03:04.666665 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:03:05.215238 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 23:03:05.220285 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:03:05.231063 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:03:05.268150 tst handover.py: using LAC 17355 23:03:05.388271 tst handover.py: using RAC 15 23:03:05.509387 tst handover.py: using CellId 17355 23:03:05.632001 tst handover.py: using BVCI 17356 23:03:05.745253 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:03:05.793542 tst handover.py: using LAC 17356 23:03:05.921711 tst handover.py: using RAC 16 23:03:06.051994 tst handover.py: using CellId 17356 23:03:06.181383 tst handover.py: using BVCI 17357 23:03:06.294128 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:03:06.305221 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:03:06.316081 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:03:06.327345 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:03:06.338947 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:03:06.350435 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:03:06.469653 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:03:06.589108 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:03:07.065101 run create_hlr_db(pid=25336): Launched 23:03:07.197400 bus /sierra_2: Setting Powered False 23:03:08.261296 run create_hlr_db(pid=25336): Terminated: ok {rc=0} 23:03:08.687118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25338): Launched 23:03:09.013196 run osmo-hlr_10.42.42.2(pid=25339): Launched 23:03:09.137709 run osmo-stp_10.42.42.5: Starting osmo-stp 23:03:09.675955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25341): Launched 23:03:10.001550 run osmo-stp_10.42.42.5(pid=25342): Launched 23:03:10.126613 run osmo-msc_10.42.42.6: Starting osmo-msc 23:03:10.691917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25344): Launched 23:03:11.016864 run osmo-msc_10.42.42.6(pid=25345): Launched 23:03:11.198860 run osmo-stp_10.42.42.5(pid=25342): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25342)] 23:03:11.337380 run osmo-stp_10.42.42.5(pid=25342): stdout: | (launched: 2022-12-08_23:03:09.941805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:11.475704 run osmo-stp_10.42.42.5(pid=25342): stderr: | 20221208230310133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230310133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230310133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230310133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230310134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230310134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230310134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:11.613424 run osmo-stp_10.42.42.5(pid=25342): stdout: | (launched: 2022-12-08_23:03:09.941805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:11.743551 run osmo-stp_10.42.42.5(pid=25342): stderr: | 20221208230310133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230310133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230310133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230310133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230310134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230310134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230310134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:11.899733 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25342): Process ended prematurely: osmo-stp_10.42.42.5(pid=25342) [trial-2350↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25342)] [trial-2350↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 23:03:11.908490 tst handover.py:18: Test FAILED (6.7 sec) 23:03:11.936400 run osmo-hlr_10.42.42.2(pid=25339): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25339)] 23:03:11.987753 run osmo-hlr_10.42.42.2(pid=25339): stdout: | (launched: 2022-12-08_23:03:08.954245) 23:03:12.040857 run osmo-hlr_10.42.42.2(pid=25339): stderr: | 20221208230309151 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230309151 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230309151 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230309151 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230309151 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230309151 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230309166 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230309174 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230309174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230309174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:03:12.114743 run osmo-msc_10.42.42.6(pid=25345): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25345)] 23:03:12.165750 run osmo-msc_10.42.42.6(pid=25345): stdout: | (launched: 2022-12-08_23:03:10.957954) 23:03:12.218515 run osmo-msc_10.42.42.6(pid=25345): stderr: | 20221208230311280 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230311280 DLGLOBAL DEBUG validating counter group 0x7f7b3a760c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230311280 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230311280 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230311281 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230311281 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230311282 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230311283 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230311283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230311283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:03:12.271643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25338): Terminating (SIGTERM) 23:03:12.314792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25341): Terminating (SIGTERM) 23:03:12.357637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25344): Terminating (SIGTERM) 23:03:12.400419 --- ParallelTerminationStrategy: PID 25338 died... 23:03:12.420724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25338): Terminated: ok {rc=0} 23:03:12.468337 --- ParallelTerminationStrategy: PID 25341 died... 23:03:12.488184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25341): Terminated: ok {rc=0} 23:03:12.535135 --- ParallelTerminationStrategy: PID 25344 died... 23:03:12.555159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25344): Terminated: ok {rc=0} 23:03:12.643777 bus /sierra_3: Setting Powered False 23:03:13.744618 bus /sierra_3: Setting Powered False 23:03:14.863436 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 23:03:16.133492 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:03:16.141420 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:03:16.210800 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:03:16.246143 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:03:16.306905 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:03:16.366772 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:03:16.403821 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:03:16.945989 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 23:03:16.952016 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:03:16.964102 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:03:17.001943 tst handover.py: using LAC 17357 23:03:17.133332 tst handover.py: using RAC 17 23:03:17.254663 tst handover.py: using CellId 17357 23:03:17.376125 tst handover.py: using BVCI 17358 23:03:17.488496 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:03:17.534341 tst handover.py: using LAC 17358 23:03:17.655822 tst handover.py: using RAC 18 23:03:17.775428 tst handover.py: using CellId 17358 23:03:17.896255 tst handover.py: using BVCI 17359 23:03:18.008284 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:03:18.019074 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:03:18.029747 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:03:18.040540 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:03:18.051435 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:03:18.062622 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:03:18.179591 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:03:18.295976 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:03:18.743191 run create_hlr_db(pid=25350): Launched 23:03:18.859055 bus /sierra_2: Setting Powered False 23:03:19.920093 run create_hlr_db(pid=25350): Terminated: ok {rc=0} 23:03:20.322121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25352): Launched 23:03:20.626590 run osmo-hlr_10.42.42.2(pid=25353): Launched 23:03:20.743730 run osmo-stp_10.42.42.5: Starting osmo-stp 23:03:21.257695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25355): Launched 23:03:21.563922 run osmo-stp_10.42.42.5(pid=25356): Launched 23:03:21.681133 run osmo-msc_10.42.42.6: Starting osmo-msc 23:03:22.209143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25358): Launched 23:03:22.514757 run osmo-msc_10.42.42.6(pid=25359): Launched 23:03:22.686132 run osmo-stp_10.42.42.5(pid=25356): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25356)] 23:03:22.816685 run osmo-stp_10.42.42.5(pid=25356): stdout: | (launched: 2022-12-08_23:03:21.507816) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:22.946769 run osmo-stp_10.42.42.5(pid=25356): stderr: | 20221208230321679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230321679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230321680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230321680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230321680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230321681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230321681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:23.075102 run osmo-stp_10.42.42.5(pid=25356): stdout: | (launched: 2022-12-08_23:03:21.507816) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:23.197844 run osmo-stp_10.42.42.5(pid=25356): stderr: | 20221208230321679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230321679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230321680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230321680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230321680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230321681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230321681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:23.344429 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25356): Process ended prematurely: osmo-stp_10.42.42.5(pid=25356) [trial-2350↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25356)] [trial-2350↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 23:03:23.352756 tst handover.py:18: Test FAILED (6.4 sec) 23:03:23.379564 run osmo-hlr_10.42.42.2(pid=25353): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25353)] 23:03:23.429117 run osmo-hlr_10.42.42.2(pid=25353): stdout: | (launched: 2022-12-08_23:03:20.571264) 23:03:23.480306 run osmo-hlr_10.42.42.2(pid=25353): stderr: | 20221208230320747 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230320748 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230320748 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230320748 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230320748 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230320748 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230320760 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230320769 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230320769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230320769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:03:23.551837 run osmo-msc_10.42.42.6(pid=25359): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25359)] 23:03:23.601299 run osmo-msc_10.42.42.6(pid=25359): stdout: | (launched: 2022-12-08_23:03:22.458892) 23:03:23.652278 run osmo-msc_10.42.42.6(pid=25359): stderr: | 20221208230322730 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230322730 DLGLOBAL DEBUG validating counter group 0x7f6588e7bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230322730 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230322730 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230322730 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230322731 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230322732 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230322733 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230322733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230322733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:03:23.703662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25352): Terminating (SIGTERM) 23:03:23.744622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25355): Terminating (SIGTERM) 23:03:23.785566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25358): Terminating (SIGTERM) 23:03:23.826715 --- ParallelTerminationStrategy: PID 25352 died... 23:03:23.846155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25352): Terminated: ok {rc=0} 23:03:23.891622 --- ParallelTerminationStrategy: PID 25355 died... 23:03:23.910683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25355): Terminated: ok {rc=0} 23:03:23.956390 --- ParallelTerminationStrategy: PID 25358 died... 23:03:23.975417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25358): Terminated: ok {rc=0} 23:03:24.061949 bus /sierra_3: Setting Powered False 23:03:25.162800 bus /sierra_3: Setting Powered False 23:03:26.282754 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 23:03:27.544845 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:03:27.549820 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 23:03:27.587070 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 23:03:27.613225 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 23:03:27.662922 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 23:03:27.698901 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 23:03:27.725092 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 23:03:28.283147 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 23:03:28.288712 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:03:28.300488 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 23:03:28.335902 tst handover.py: using LAC 17359 23:03:28.463480 tst handover.py: using RAC 19 23:03:28.591986 tst handover.py: using CellId 17359 23:03:28.718643 tst handover.py: using BVCI 17360 23:03:28.837038 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 23:03:28.875542 tst handover.py: using LAC 17360 23:03:28.995475 tst handover.py: using RAC 20 23:03:29.114538 tst handover.py: using CellId 17360 23:03:29.236323 tst handover.py: using BVCI 17361 23:03:29.348056 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:03:29.358993 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:03:29.369740 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:03:29.380564 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:03:29.391572 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:03:29.402659 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 23:03:29.519916 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 23:03:29.640529 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:03:30.119391 run create_hlr_db(pid=25366): Launched 23:03:30.253158 bus /sierra_2: Setting Powered False 23:03:31.325566 run create_hlr_db(pid=25366): Terminated: ok {rc=0} 23:03:31.763053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25368): Launched 23:03:32.105742 run osmo-hlr_10.42.42.2(pid=25369): Launched 23:03:32.247723 run osmo-stp_10.42.42.5: Starting osmo-stp 23:03:32.784313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25371): Launched 23:03:33.110422 run osmo-stp_10.42.42.5(pid=25372): Launched 23:03:33.234514 run osmo-msc_10.42.42.6: Starting osmo-msc 23:03:33.798105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25374): Launched 23:03:34.125642 run osmo-msc_10.42.42.6(pid=25375): Launched 23:03:34.310047 run osmo-stp_10.42.42.5(pid=25372): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25372)] 23:03:34.449169 run osmo-stp_10.42.42.5(pid=25372): stdout: | (launched: 2022-12-08_23:03:33.051419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:34.588513 run osmo-stp_10.42.42.5(pid=25372): stderr: | 20221208230333242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230333242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230333242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230333243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230333245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230333245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230333245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:34.726574 run osmo-stp_10.42.42.5(pid=25372): stdout: | (launched: 2022-12-08_23:03:33.051419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:34.857592 run osmo-stp_10.42.42.5(pid=25372): stderr: | 20221208230333242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230333242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230333242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230333243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230333245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230333245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230333245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:35.014231 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25372): Process ended prematurely: osmo-stp_10.42.42.5(pid=25372) [trial-2350↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25372)] [trial-2350↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 23:03:35.023189 tst handover.py:18: Test FAILED (6.7 sec) 23:03:35.050908 run osmo-hlr_10.42.42.2(pid=25369): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25369)] 23:03:35.102016 run osmo-hlr_10.42.42.2(pid=25369): stdout: | (launched: 2022-12-08_23:03:32.042184) 23:03:35.154253 run osmo-hlr_10.42.42.2(pid=25369): stderr: | 20221208230332299 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230332299 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230332299 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230332299 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230332299 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230332299 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230332323 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230332333 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230332333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230332333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:03:35.227237 run osmo-msc_10.42.42.6(pid=25375): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25375)] 23:03:35.277834 run osmo-msc_10.42.42.6(pid=25375): stdout: | (launched: 2022-12-08_23:03:34.066209) 23:03:35.330490 run osmo-msc_10.42.42.6(pid=25375): stderr: | 20221208230334388 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230334388 DLGLOBAL DEBUG validating counter group 0x7f1d14b4fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230334388 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230334388 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230334389 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230334389 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230334390 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230334391 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230334391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230334391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:03:35.383281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25368): Terminating (SIGTERM) 23:03:35.425485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25371): Terminating (SIGTERM) 23:03:35.467815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25374): Terminating (SIGTERM) 23:03:35.510683 --- ParallelTerminationStrategy: PID 25368 died... 23:03:35.530989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25368): Terminated: ok {rc=0} 23:03:35.578296 --- ParallelTerminationStrategy: PID 25371 died... 23:03:35.598272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25371): Terminated: ok {rc=0} 23:03:35.645307 --- ParallelTerminationStrategy: PID 25374 died... 23:03:35.665125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25374): Terminated: ok {rc=0} 23:03:35.754246 bus /sierra_3: Setting Powered False 23:03:36.855171 bus /sierra_3: Setting Powered False 23:03:37.972577 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 23:03:39.212771 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:03:39.218558 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 23:03:39.269466 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 23:03:39.297049 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 23:03:39.348186 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 23:03:39.399067 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 23:03:39.426170 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 23:03:39.978888 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 23:03:39.985227 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:03:39.996446 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 23:03:40.032190 tst handover.py: using LAC 17361 23:03:40.158976 tst handover.py: using RAC 21 23:03:40.287343 tst handover.py: using CellId 17361 23:03:40.414354 tst handover.py: using BVCI 17362 23:03:40.534504 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 23:03:40.582464 tst handover.py: using LAC 17362 23:03:40.710889 tst handover.py: using RAC 22 23:03:40.836933 tst handover.py: using CellId 17362 23:03:40.963005 tst handover.py: using BVCI 17363 23:03:41.082952 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:03:41.094189 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:03:41.105851 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:03:41.116848 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:03:41.128065 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:03:41.139143 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 23:03:41.253399 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 23:03:41.371390 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:03:41.848183 run create_hlr_db(pid=25380): Launched 23:03:41.981339 bus /sierra_2: Setting Powered False 23:03:43.045939 run create_hlr_db(pid=25380): Terminated: ok {rc=0} 23:03:43.473130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25382): Launched 23:03:43.798801 run osmo-hlr_10.42.42.2(pid=25383): Launched 23:03:43.922739 run osmo-stp_10.42.42.5: Starting osmo-stp 23:03:44.456036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25385): Launched 23:03:44.781059 run osmo-stp_10.42.42.5(pid=25386): Launched 23:03:44.905224 run osmo-msc_10.42.42.6: Starting osmo-msc 23:03:45.466566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25388): Launched 23:03:45.793082 run osmo-msc_10.42.42.6(pid=25389): Launched 23:03:46.118304 run osmo-stp_10.42.42.5(pid=25386): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25386)] 23:03:46.400741 run osmo-stp_10.42.42.5(pid=25386): stdout: | (launched: 2022-12-08_23:03:44.721867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:46.547454 run osmo-stp_10.42.42.5(pid=25386): stderr: | 20221208230344913 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230344914 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230344914 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230344914 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230344915 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230344915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230344915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:46.728129 run osmo-stp_10.42.42.5(pid=25386): stdout: | (launched: 2022-12-08_23:03:44.721867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:46.880666 run osmo-stp_10.42.42.5(pid=25386): stderr: | 20221208230344913 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230344914 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230344914 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230344914 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230344915 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230344915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230344915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:47.034666 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25386): Process ended prematurely: osmo-stp_10.42.42.5(pid=25386) [trial-2350↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25386)] [trial-2350↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 23:03:47.043217 tst handover.py:18: Test FAILED (7.1 sec) 23:03:47.071098 run osmo-hlr_10.42.42.2(pid=25383): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25383)] 23:03:47.122818 run osmo-hlr_10.42.42.2(pid=25383): stdout: | (launched: 2022-12-08_23:03:43.739788) 23:03:47.175186 run osmo-hlr_10.42.42.2(pid=25383): stderr: | 20221208230343936 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230343936 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230343936 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230343936 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230343936 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230343936 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230343948 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230343958 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230343958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230343958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:03:47.248144 run osmo-msc_10.42.42.6(pid=25389): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25389)] 23:03:47.298821 run osmo-msc_10.42.42.6(pid=25389): stdout: | (launched: 2022-12-08_23:03:45.733868) 23:03:47.351570 run osmo-msc_10.42.42.6(pid=25389): stderr: | 20221208230346211 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230346212 DLGLOBAL DEBUG validating counter group 0x7ff51135ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230346212 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230346212 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230346212 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230346212 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230346214 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230346214 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230346215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230346215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:03:47.404170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25382): Terminating (SIGTERM) 23:03:47.444820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25385): Terminating (SIGTERM) 23:03:47.485730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25388): Terminating (SIGTERM) 23:03:47.526960 --- ParallelTerminationStrategy: PID 25382 died... 23:03:47.546394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25382): Terminated: ok {rc=0} 23:03:47.592210 --- ParallelTerminationStrategy: PID 25385 died... 23:03:47.611196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25385): Terminated: ok {rc=0} 23:03:47.656616 --- ParallelTerminationStrategy: PID 25388 died... 23:03:47.675580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25388): Terminated: ok {rc=0} 23:03:47.760536 bus /sierra_3: Setting Powered False 23:03:48.857547 bus /sierra_3: Setting Powered False 23:03:49.973087 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 23:03:51.226602 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:03:51.231602 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 23:03:51.277554 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 23:03:51.303617 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 23:03:51.355750 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 23:03:51.403070 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 23:03:51.430115 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 23:03:51.977532 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 23:03:51.983024 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:03:51.994132 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:03:52.031998 tst handover.py: using LAC 17363 23:03:52.152808 tst handover.py: using RAC 23 23:03:52.272091 tst handover.py: using CellId 17363 23:03:52.391164 tst handover.py: using BVCI 17364 23:03:52.504066 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:03:52.550876 tst handover.py: using LAC 17364 23:03:52.670769 tst handover.py: using RAC 24 23:03:52.791015 tst handover.py: using CellId 17364 23:03:52.909590 tst handover.py: using BVCI 17365 23:03:53.029807 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:03:53.041393 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:03:53.052698 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:03:53.064358 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:03:53.075994 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:03:53.087488 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:03:53.204389 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:03:53.320262 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:03:53.766990 run create_hlr_db(pid=25394): Launched 23:03:53.884476 bus /sierra_2: Setting Powered False 23:03:54.945518 run create_hlr_db(pid=25394): Terminated: ok {rc=0} 23:03:55.347182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25396): Launched 23:03:55.653694 run osmo-hlr_10.42.42.2(pid=25397): Launched 23:03:55.771638 run osmo-stp_10.42.42.5: Starting osmo-stp 23:03:56.292174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25399): Launched 23:03:56.599013 run osmo-stp_10.42.42.5(pid=25400): Launched 23:03:56.716176 run osmo-msc_10.42.42.6: Starting osmo-msc 23:03:57.243922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25402): Launched 23:03:57.551663 run osmo-msc_10.42.42.6(pid=25403): Launched 23:03:57.723514 run osmo-stp_10.42.42.5(pid=25400): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25400)] 23:03:57.854104 run osmo-stp_10.42.42.5(pid=25400): stdout: | (launched: 2022-12-08_23:03:56.543312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:57.983937 run osmo-stp_10.42.42.5(pid=25400): stderr: | 20221208230356713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230356713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230356713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230356714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230356716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230356716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230356716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:58.111912 run osmo-stp_10.42.42.5(pid=25400): stdout: | (launched: 2022-12-08_23:03:56.543312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:58.234158 run osmo-stp_10.42.42.5(pid=25400): stderr: | 20221208230356713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230356713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230356713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230356714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230356716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230356716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230356716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:58.380506 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25400): Process ended prematurely: osmo-stp_10.42.42.5(pid=25400) [trial-2350↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25400)] [trial-2350↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 23:03:58.388795 tst handover.py:18: Test FAILED (6.4 sec) 23:03:58.415755 run osmo-hlr_10.42.42.2(pid=25397): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25397)] 23:03:58.464667 run osmo-hlr_10.42.42.2(pid=25397): stdout: | (launched: 2022-12-08_23:03:55.597872) 23:03:58.515263 run osmo-hlr_10.42.42.2(pid=25397): stderr: | 20221208230355774 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230355774 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230355774 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230355774 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230355774 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230355774 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230355787 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230355795 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230355795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230355795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:03:58.585442 run osmo-msc_10.42.42.6(pid=25403): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25403)] 23:03:58.634379 run osmo-msc_10.42.42.6(pid=25403): stdout: | (launched: 2022-12-08_23:03:57.495642) 23:03:58.684871 run osmo-msc_10.42.42.6(pid=25403): stderr: | 20221208230357765 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230357765 DLGLOBAL DEBUG validating counter group 0x7fbc8d005c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230357765 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230357765 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230357765 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230357765 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230357767 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230357767 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230357768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230357768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:03:58.735774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25396): Terminating (SIGTERM) 23:03:58.776327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25399): Terminating (SIGTERM) 23:03:58.817053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25402): Terminating (SIGTERM) 23:03:58.857939 --- ParallelTerminationStrategy: PID 25396 died... 23:03:58.877085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25396): Terminated: ok {rc=0} 23:03:58.922227 --- ParallelTerminationStrategy: PID 25399 died... 23:03:58.940880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25399): Terminated: ok {rc=0} 23:03:58.986208 --- ParallelTerminationStrategy: PID 25402 died... 23:03:59.004937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25402): Terminated: ok {rc=0} 23:03:59.089391 bus /sierra_3: Setting Powered False 23:04:00.185218 bus /sierra_3: Setting Powered False 23:04:01.300092 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 23:04:02.560164 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:04:02.566080 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 23:04:02.617465 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:04:02.644466 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 23:04:02.697585 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 23:04:02.749567 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:04:02.776626 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 23:04:03.328281 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 23:04:03.333602 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:04:03.345012 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:04:03.380028 tst handover.py: using LAC 17365 23:04:03.507932 tst handover.py: using RAC 25 23:04:03.637527 tst handover.py: using CellId 17365 23:04:03.760157 tst handover.py: using BVCI 17366 23:04:03.872341 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:04:03.921596 tst handover.py: using LAC 17366 23:04:04.045193 tst handover.py: using RAC 26 23:04:04.166391 tst handover.py: using CellId 17366 23:04:04.289116 tst handover.py: using BVCI 17367 23:04:04.401591 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:04:04.412560 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:04:04.423413 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:04:04.435106 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:04:04.446973 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:04:04.458331 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:04:04.579513 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:04:04.698947 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:04:05.175615 run create_hlr_db(pid=25408): Launched 23:04:05.309281 bus /sierra_2: Setting Powered False 23:04:06.373572 run create_hlr_db(pid=25408): Terminated: ok {rc=0} 23:04:06.784168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25410): Launched 23:04:07.090863 run osmo-hlr_10.42.42.2(pid=25411): Launched 23:04:07.207450 run osmo-stp_10.42.42.5: Starting osmo-stp 23:04:07.720182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25413): Launched 23:04:08.025973 run osmo-stp_10.42.42.5(pid=25414): Launched 23:04:08.142784 run osmo-msc_10.42.42.6: Starting osmo-msc 23:04:08.669955 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25416): Launched 23:04:08.975132 run osmo-msc_10.42.42.6(pid=25417): Launched 23:04:09.146226 run osmo-stp_10.42.42.5(pid=25414): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25414)] 23:04:09.276352 run osmo-stp_10.42.42.5(pid=25414): stdout: | (launched: 2022-12-08_23:04:07.970489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:09.406218 run osmo-stp_10.42.42.5(pid=25414): stderr: | 20221208230408140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230408140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230408140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230408141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230408141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230408141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230408142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:09.534057 run osmo-stp_10.42.42.5(pid=25414): stdout: | (launched: 2022-12-08_23:04:07.970489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:09.655742 run osmo-stp_10.42.42.5(pid=25414): stderr: | 20221208230408140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230408140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230408140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230408141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230408141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230408141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230408142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:09.801542 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25414): Process ended prematurely: osmo-stp_10.42.42.5(pid=25414) [trial-2350↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25414)] [trial-2350↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 23:04:09.809613 tst handover.py:18: Test FAILED (6.5 sec) 23:04:09.836317 run osmo-hlr_10.42.42.2(pid=25411): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25411)] 23:04:09.885101 run osmo-hlr_10.42.42.2(pid=25411): stdout: | (launched: 2022-12-08_23:04:07.035036) 23:04:09.935608 run osmo-hlr_10.42.42.2(pid=25411): stderr: | 20221208230407211 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230407211 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230407211 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230407211 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230407211 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230407211 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230407223 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230407233 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230407234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230407234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:04:10.005522 run osmo-msc_10.42.42.6(pid=25417): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25417)] 23:04:10.054191 run osmo-msc_10.42.42.6(pid=25417): stdout: | (launched: 2022-12-08_23:04:08.919339) 23:04:10.104228 run osmo-msc_10.42.42.6(pid=25417): stderr: | 20221208230409191 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230409191 DLGLOBAL DEBUG validating counter group 0x7f1eee67fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230409191 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230409191 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230409191 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230409191 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230409193 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230409194 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230409194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230409194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:04:10.154732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25410): Terminating (SIGTERM) 23:04:10.195013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25413): Terminating (SIGTERM) 23:04:10.235526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25416): Terminating (SIGTERM) 23:04:10.276325 --- ParallelTerminationStrategy: PID 25410 died... 23:04:10.295672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25410): Terminated: ok {rc=0} 23:04:10.341113 --- ParallelTerminationStrategy: PID 25413 died... 23:04:10.359979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25413): Terminated: ok {rc=0} 23:04:10.405286 --- ParallelTerminationStrategy: PID 25416 died... 23:04:10.424060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25416): Terminated: ok {rc=0} 23:04:10.512013 bus /sierra_3: Setting Powered False 23:04:11.613128 bus /sierra_3: Setting Powered False 23:04:12.727739 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 23:04:13.979927 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:04:13.984805 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 23:04:14.023522 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 23:04:14.049902 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 23:04:14.102180 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 23:04:14.140196 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 23:04:14.166171 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 23:04:14.713529 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 23:04:14.718614 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:04:14.729403 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 23:04:14.762986 tst handover.py: using LAC 17367 23:04:14.887958 tst handover.py: using RAC 27 23:04:15.008059 tst handover.py: using CellId 17367 23:04:15.136745 tst handover.py: using BVCI 17368 23:04:15.255378 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 23:04:15.289589 tst handover.py: using LAC 17368 23:04:15.416505 tst handover.py: using RAC 28 23:04:15.542041 tst handover.py: using CellId 17368 23:04:15.671378 tst handover.py: using BVCI 17369 23:04:15.789985 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:04:15.801111 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:04:15.812004 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:04:15.823066 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:04:15.842857 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:04:15.854648 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 23:04:15.981280 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 23:04:16.100580 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:04:16.566788 run create_hlr_db(pid=25422): Launched 23:04:16.720127 bus /sierra_2: Setting Powered False 23:04:17.784066 run create_hlr_db(pid=25422): Terminated: ok {rc=0} 23:04:18.211250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25424): Launched 23:04:18.538352 run osmo-hlr_10.42.42.2(pid=25425): Launched 23:04:18.663424 run osmo-stp_10.42.42.5: Starting osmo-stp 23:04:19.196031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25427): Launched 23:04:19.523423 run osmo-stp_10.42.42.5(pid=25428): Launched 23:04:19.648119 run osmo-msc_10.42.42.6: Starting osmo-msc 23:04:20.209524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25430): Launched 23:04:20.537633 run osmo-msc_10.42.42.6(pid=25431): Launched 23:04:20.720195 run osmo-stp_10.42.42.5(pid=25428): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25428)] 23:04:20.857904 run osmo-stp_10.42.42.5(pid=25428): stdout: | (launched: 2022-12-08_23:04:19.464191) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:20.996366 run osmo-stp_10.42.42.5(pid=25428): stderr: | 20221208230419655 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230419655 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230419656 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230419656 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230419656 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230419657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230419657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:21.134381 run osmo-stp_10.42.42.5(pid=25428): stdout: | (launched: 2022-12-08_23:04:19.464191) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:21.264825 run osmo-stp_10.42.42.5(pid=25428): stderr: | 20221208230419655 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230419655 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230419656 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230419656 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230419656 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230419657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230419657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:21.421322 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25428): Process ended prematurely: osmo-stp_10.42.42.5(pid=25428) [trial-2350↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25428)] [trial-2350↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 23:04:21.430409 tst handover.py:18: Test FAILED (6.7 sec) 23:04:21.458345 run osmo-hlr_10.42.42.2(pid=25425): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25425)] 23:04:21.509185 run osmo-hlr_10.42.42.2(pid=25425): stdout: | (launched: 2022-12-08_23:04:18.479173) 23:04:21.561954 run osmo-hlr_10.42.42.2(pid=25425): stderr: | 20221208230418679 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230418679 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230418679 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230418679 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230418679 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230418680 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230418691 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230418699 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230418700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230418700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:04:21.635689 run osmo-msc_10.42.42.6(pid=25431): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25431)] 23:04:21.686547 run osmo-msc_10.42.42.6(pid=25431): stdout: | (launched: 2022-12-08_23:04:20.478275) 23:04:21.739216 run osmo-msc_10.42.42.6(pid=25431): stderr: | 20221208230420802 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230420802 DLGLOBAL DEBUG validating counter group 0x7eff6f669c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230420802 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230420802 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230420803 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230420803 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230420804 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230420805 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230420805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230420805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:04:21.792122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25424): Terminating (SIGTERM) 23:04:21.834451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25427): Terminating (SIGTERM) 23:04:21.877065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25430): Terminating (SIGTERM) 23:04:21.919632 --- ParallelTerminationStrategy: PID 25424 died... 23:04:21.939507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25424): Terminated: ok {rc=0} 23:04:21.986485 --- ParallelTerminationStrategy: PID 25427 died... 23:04:22.006301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25427): Terminated: ok {rc=0} 23:04:22.053028 --- ParallelTerminationStrategy: PID 25430 died... 23:04:22.073238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25430): Terminated: ok {rc=0} 23:04:22.160782 bus /sierra_3: Setting Powered False 23:04:23.260182 bus /sierra_3: Setting Powered False 23:04:24.376547 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 23:04:25.621930 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:04:25.627569 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:04:25.678840 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:04:25.706013 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:04:25.758352 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:04:25.809155 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:04:25.836123 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:04:26.387082 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 23:04:26.393133 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:04:26.404105 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:04:26.440359 tst handover.py: using LAC 17369 23:04:26.568546 tst handover.py: using RAC 29 23:04:26.697237 tst handover.py: using CellId 17369 23:04:26.825155 tst handover.py: using BVCI 17370 23:04:26.945024 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:04:26.994961 tst handover.py: using LAC 17370 23:04:27.122732 tst handover.py: using RAC 30 23:04:27.252196 tst handover.py: using CellId 17370 23:04:27.380161 tst handover.py: using BVCI 17371 23:04:27.498736 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:04:27.509954 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:04:27.520890 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:04:27.532028 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:04:27.543126 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:04:27.554128 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:04:27.670731 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:04:27.784291 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:04:28.233754 run create_hlr_db(pid=25436): Launched 23:04:28.352707 bus /sierra_2: Setting Powered False 23:04:29.414295 run create_hlr_db(pid=25436): Terminated: ok {rc=0} 23:04:29.815818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25438): Launched 23:04:30.122645 run osmo-hlr_10.42.42.2(pid=25439): Launched 23:04:30.239661 run osmo-stp_10.42.42.5: Starting osmo-stp 23:04:30.756235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25441): Launched 23:04:31.068731 run osmo-stp_10.42.42.5(pid=25442): Launched 23:04:31.316588 run osmo-msc_10.42.42.6: Starting osmo-msc 23:04:31.982508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25444): Launched 23:04:32.306169 run osmo-msc_10.42.42.6(pid=25445): Launched 23:04:32.478450 run osmo-stp_10.42.42.5(pid=25442): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25442)] 23:04:32.609464 run osmo-stp_10.42.42.5(pid=25442): stdout: | (launched: 2022-12-08_23:04:31.010610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:32.740071 run osmo-stp_10.42.42.5(pid=25442): stderr: | 20221208230431321 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230431321 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230431322 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230431322 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230431322 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230431323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230431323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:32.868786 run osmo-stp_10.42.42.5(pid=25442): stdout: | (launched: 2022-12-08_23:04:31.010610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:32.991670 run osmo-stp_10.42.42.5(pid=25442): stderr: | 20221208230431321 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230431321 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230431322 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230431322 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230431322 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230431323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230431323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:33.138466 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25442): Process ended prematurely: osmo-stp_10.42.42.5(pid=25442) [trial-2350↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25442)] [trial-2350↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 23:04:33.146809 tst handover.py:18: Test FAILED (6.7 sec) 23:04:33.174113 run osmo-hlr_10.42.42.2(pid=25439): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25439)] 23:04:33.223432 run osmo-hlr_10.42.42.2(pid=25439): stdout: | (launched: 2022-12-08_23:04:30.067120) 23:04:33.274517 run osmo-hlr_10.42.42.2(pid=25439): stderr: | 20221208230430242 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230430242 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230430242 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230430242 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230430242 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230430242 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230430254 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230430264 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230430264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230430264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:04:33.345770 run osmo-msc_10.42.42.6(pid=25445): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25445)] 23:04:33.395294 run osmo-msc_10.42.42.6(pid=25445): stdout: | (launched: 2022-12-08_23:04:32.249400) 23:04:33.445627 run osmo-msc_10.42.42.6(pid=25445): stderr: | 20221208230432520 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230432520 DLGLOBAL DEBUG validating counter group 0x7f95ea6ccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230432520 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230432521 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230432521 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230432521 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230432523 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230432523 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230432523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230432524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:04:33.496514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25438): Terminating (SIGTERM) 23:04:33.537266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25441): Terminating (SIGTERM) 23:04:33.577969 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25444): Terminating (SIGTERM) 23:04:33.618927 --- ParallelTerminationStrategy: PID 25438 died... 23:04:33.638165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25438): Terminated: ok {rc=0} 23:04:33.683604 --- ParallelTerminationStrategy: PID 25441 died... 23:04:33.702412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25441): Terminated: ok {rc=0} 23:04:33.747644 --- ParallelTerminationStrategy: PID 25444 died... 23:04:33.766504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25444): Terminated: ok {rc=0} 23:04:33.853318 bus /sierra_3: Setting Powered False 23:04:34.953299 bus /sierra_3: Setting Powered False 23:04:36.067379 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 23:04:37.323491 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:04:37.329366 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:04:37.381201 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:04:37.408589 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:04:37.461613 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:04:37.511975 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:04:37.539310 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:04:38.092048 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 23:04:38.097459 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:04:38.108494 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:04:38.147818 tst handover.py: using LAC 17371 23:04:38.275148 tst handover.py: using RAC 31 23:04:38.401033 tst handover.py: using CellId 17371 23:04:38.529644 tst handover.py: using BVCI 17372 23:04:38.649247 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:04:38.696307 tst handover.py: using LAC 17372 23:04:38.823600 tst handover.py: using RAC 32 23:04:38.949496 tst handover.py: using CellId 17372 23:04:39.069992 tst handover.py: using BVCI 17373 23:04:39.181540 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:04:39.192375 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:04:39.203264 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:04:39.214528 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:04:39.225963 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:04:39.237190 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:04:39.353775 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:04:39.469446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:04:39.916006 run create_hlr_db(pid=25450): Launched 23:04:40.033717 bus /sierra_2: Setting Powered False 23:04:41.094500 run create_hlr_db(pid=25450): Terminated: ok {rc=0} 23:04:41.495514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25452): Launched 23:04:41.802267 run osmo-hlr_10.42.42.2(pid=25453): Launched 23:04:41.918923 run osmo-stp_10.42.42.5: Starting osmo-stp 23:04:42.436474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25455): Launched 23:04:42.742352 run osmo-stp_10.42.42.5(pid=25456): Launched 23:04:42.859868 run osmo-msc_10.42.42.6: Starting osmo-msc 23:04:43.387469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25458): Launched 23:04:43.693191 run osmo-msc_10.42.42.6(pid=25459): Launched 23:04:43.865113 run osmo-stp_10.42.42.5(pid=25456): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25456)] 23:04:43.995481 run osmo-stp_10.42.42.5(pid=25456): stdout: | (launched: 2022-12-08_23:04:42.686328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:44.125828 run osmo-stp_10.42.42.5(pid=25456): stderr: | 20221208230442855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230442855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230442856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230442856 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230442857 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230442857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230442857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:44.254645 run osmo-stp_10.42.42.5(pid=25456): stdout: | (launched: 2022-12-08_23:04:42.686328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:44.376804 run osmo-stp_10.42.42.5(pid=25456): stderr: | 20221208230442855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230442855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230442856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230442856 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230442857 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230442857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230442857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:44.523748 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25456): Process ended prematurely: osmo-stp_10.42.42.5(pid=25456) [trial-2350↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25456)] [trial-2350↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 23:04:44.532145 tst handover.py:18: Test FAILED (6.4 sec) 23:04:44.559223 run osmo-hlr_10.42.42.2(pid=25453): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25453)] 23:04:44.607978 run osmo-hlr_10.42.42.2(pid=25453): stdout: | (launched: 2022-12-08_23:04:41.746118) 23:04:44.658176 run osmo-hlr_10.42.42.2(pid=25453): stderr: | 20221208230441924 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230441924 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230441924 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230441924 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230441924 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230441924 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230441935 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230441946 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230441946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230441946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:04:44.728173 run osmo-msc_10.42.42.6(pid=25459): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25459)] 23:04:44.776771 run osmo-msc_10.42.42.6(pid=25459): stdout: | (launched: 2022-12-08_23:04:43.637540) 23:04:44.826888 run osmo-msc_10.42.42.6(pid=25459): stderr: | 20221208230443906 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230443906 DLGLOBAL DEBUG validating counter group 0x7fa482f54c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230443906 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230443906 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230443906 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230443907 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230443908 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230443909 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230443909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230443909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:04:44.877284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25452): Terminating (SIGTERM) 23:04:44.917321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25455): Terminating (SIGTERM) 23:04:44.957786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25458): Terminating (SIGTERM) 23:04:44.998470 --- ParallelTerminationStrategy: PID 25452 died... 23:04:45.017849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25452): Terminated: ok {rc=0} 23:04:45.063325 --- ParallelTerminationStrategy: PID 25455 died... 23:04:45.082261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25455): Terminated: ok {rc=0} 23:04:45.127548 --- ParallelTerminationStrategy: PID 25458 died... 23:04:45.146613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25458): Terminated: ok {rc=0} 23:04:45.230991 bus /sierra_3: Setting Powered False 23:04:46.328302 bus /sierra_3: Setting Powered False 23:04:47.447806 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 23:04:48.703250 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:04:48.708924 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 23:04:48.758917 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 23:04:48.786312 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 23:04:48.837284 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 23:04:48.886535 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 23:04:48.913523 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 23:04:49.467023 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 23:04:49.472261 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:04:49.483492 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 23:04:49.517087 tst handover.py: using LAC 17373 23:04:49.643996 tst handover.py: using RAC 33 23:04:49.776258 tst handover.py: using CellId 17373 23:04:49.904878 tst handover.py: using BVCI 17374 23:04:50.024502 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 23:04:50.072776 tst handover.py: using LAC 17374 23:04:50.199841 tst handover.py: using RAC 34 23:04:50.323389 tst handover.py: using CellId 17374 23:04:50.444434 tst handover.py: using BVCI 17375 23:04:50.556530 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:04:50.567692 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:04:50.578558 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:04:50.590030 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:04:50.601267 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:04:50.612342 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 23:04:50.732311 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 23:04:50.853599 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:04:51.333027 run create_hlr_db(pid=25464): Launched 23:04:51.466136 bus /sierra_2: Setting Powered False 23:04:52.530904 run create_hlr_db(pid=25464): Terminated: ok {rc=0} 23:04:52.941708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25466): Launched 23:04:53.249311 run osmo-hlr_10.42.42.2(pid=25467): Launched 23:04:53.367206 run osmo-stp_10.42.42.5: Starting osmo-stp 23:04:53.871979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25469): Launched 23:04:54.178339 run osmo-stp_10.42.42.5(pid=25470): Launched 23:04:54.294984 run osmo-msc_10.42.42.6: Starting osmo-msc 23:04:54.825909 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25472): Launched 23:04:55.132502 run osmo-msc_10.42.42.6(pid=25473): Launched 23:04:55.304540 run osmo-stp_10.42.42.5(pid=25470): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25470)] 23:04:55.435789 run osmo-stp_10.42.42.5(pid=25470): stdout: | (launched: 2022-12-08_23:04:54.122375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:55.566302 run osmo-stp_10.42.42.5(pid=25470): stderr: | 20221208230454291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230454292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230454292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230454292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230454293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230454293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230454293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:55.694794 run osmo-stp_10.42.42.5(pid=25470): stdout: | (launched: 2022-12-08_23:04:54.122375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:55.817344 run osmo-stp_10.42.42.5(pid=25470): stderr: | 20221208230454291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230454292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230454292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230454292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230454293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230454293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230454293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:55.963792 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25470): Process ended prematurely: osmo-stp_10.42.42.5(pid=25470) [trial-2350↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25470)] [trial-2350↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 23:04:55.972361 tst handover.py:18: Test FAILED (6.5 sec) 23:04:55.999395 run osmo-hlr_10.42.42.2(pid=25467): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25467)] 23:04:56.048408 run osmo-hlr_10.42.42.2(pid=25467): stdout: | (launched: 2022-12-08_23:04:53.193465) 23:04:56.099207 run osmo-hlr_10.42.42.2(pid=25467): stderr: | 20221208230453371 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230453371 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230453371 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230453371 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230453371 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230453371 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230453383 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230453392 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230453392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230453392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:04:56.169708 run osmo-msc_10.42.42.6(pid=25473): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25473)] 23:04:56.218516 run osmo-msc_10.42.42.6(pid=25473): stdout: | (launched: 2022-12-08_23:04:55.076609) 23:04:56.268875 run osmo-msc_10.42.42.6(pid=25473): stderr: | 20221208230455347 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230455347 DLGLOBAL DEBUG validating counter group 0x7efdc3279c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230455347 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230455347 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230455347 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230455348 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230455349 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230455350 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230455350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230455350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:04:56.319792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25466): Terminating (SIGTERM) 23:04:56.360704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25469): Terminating (SIGTERM) 23:04:56.401576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25472): Terminating (SIGTERM) 23:04:56.442501 --- ParallelTerminationStrategy: PID 25466 died... 23:04:56.461866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25466): Terminated: ok {rc=0} 23:04:56.507333 --- ParallelTerminationStrategy: PID 25469 died... 23:04:56.526303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25469): Terminated: ok {rc=0} 23:04:56.571836 --- ParallelTerminationStrategy: PID 25472 died... 23:04:56.591150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25472): Terminated: ok {rc=0} 23:04:56.677456 bus /sierra_3: Setting Powered False 23:04:57.775820 bus /sierra_3: Setting Powered False 23:04:58.893034 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 23:05:00.151051 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:05:00.156301 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 23:05:00.201424 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 23:05:00.228309 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 23:05:00.277809 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 23:05:00.322181 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 23:05:00.348714 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 23:05:00.921097 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 23:05:00.928336 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:00.940468 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:05:00.980220 tst handover.py: using LAC 17375 23:05:01.119711 tst handover.py: using RAC 35 23:05:01.249181 tst handover.py: using CellId 17375 23:05:01.406959 tst handover.py: using BVCI 17376 23:05:01.529306 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:05:01.574959 tst handover.py: using LAC 17376 23:05:01.736690 tst handover.py: using RAC 36 23:05:01.911177 tst handover.py: using CellId 17376 23:05:02.037104 tst handover.py: using BVCI 17377 23:05:02.154455 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:02.166745 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:02.178782 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:02.191277 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:02.204691 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:02.217674 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:05:02.331138 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:05:02.446965 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:05:02.896295 run create_hlr_db(pid=25481): Launched 23:05:03.013805 bus /sierra_2: Setting Powered False 23:05:04.076606 run create_hlr_db(pid=25481): Terminated: ok {rc=0} 23:05:04.479488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25483): Launched 23:05:04.786596 run osmo-hlr_10.42.42.2(pid=25484): Launched 23:05:04.903816 run osmo-stp_10.42.42.5: Starting osmo-stp 23:05:05.425715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25486): Launched 23:05:05.733258 run osmo-stp_10.42.42.5(pid=25487): Launched 23:05:05.850769 run osmo-msc_10.42.42.6: Starting osmo-msc 23:05:06.379045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25489): Launched 23:05:06.685585 run osmo-msc_10.42.42.6(pid=25490): Launched 23:05:06.858329 run osmo-stp_10.42.42.5(pid=25487): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25487)] 23:05:06.990261 run osmo-stp_10.42.42.5(pid=25487): stdout: | (launched: 2022-12-08_23:05:05.677151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:07.121637 run osmo-stp_10.42.42.5(pid=25487): stderr: | 20221208230505848 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230505848 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230505848 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230505849 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230505849 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230505849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230505849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:07.250863 run osmo-stp_10.42.42.5(pid=25487): stdout: | (launched: 2022-12-08_23:05:05.677151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:07.373786 run osmo-stp_10.42.42.5(pid=25487): stderr: | 20221208230505848 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230505848 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230505848 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230505849 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230505849 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230505849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230505849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:07.521285 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25487): Process ended prematurely: osmo-stp_10.42.42.5(pid=25487) [trial-2350↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25487)] [trial-2350↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 23:05:07.529673 tst handover.py:18: Test FAILED (6.6 sec) 23:05:07.556333 run osmo-hlr_10.42.42.2(pid=25484): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25484)] 23:05:07.605392 run osmo-hlr_10.42.42.2(pid=25484): stdout: | (launched: 2022-12-08_23:05:04.731223) 23:05:07.655776 run osmo-hlr_10.42.42.2(pid=25484): stderr: | 20221208230504909 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230504909 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230504909 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230504909 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230504909 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230504909 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230504920 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230504929 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230504929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230504930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:05:07.725762 run osmo-msc_10.42.42.6(pid=25490): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25490)] 23:05:07.774256 run osmo-msc_10.42.42.6(pid=25490): stdout: | (launched: 2022-12-08_23:05:06.629982) 23:05:07.824765 run osmo-msc_10.42.42.6(pid=25490): stderr: | 20221208230506900 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230506901 DLGLOBAL DEBUG validating counter group 0x7f77e5261c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230506901 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230506901 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230506901 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230506901 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230506903 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230506903 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230506903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230506903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:05:07.875477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25483): Terminating (SIGTERM) 23:05:07.915979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25486): Terminating (SIGTERM) 23:05:07.956716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25489): Terminating (SIGTERM) 23:05:07.997515 --- ParallelTerminationStrategy: PID 25483 died... 23:05:08.016709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25483): Terminated: ok {rc=0} 23:05:08.062309 --- ParallelTerminationStrategy: PID 25486 died... 23:05:08.081197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25486): Terminated: ok {rc=0} 23:05:08.126465 --- ParallelTerminationStrategy: PID 25489 died... 23:05:08.145599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25489): Terminated: ok {rc=0} 23:05:08.232462 bus /sierra_3: Setting Powered False 23:05:09.331904 bus /sierra_3: Setting Powered False 23:05:10.451750 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 23:05:11.701144 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:05:11.706411 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 23:05:11.754759 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:05:11.781716 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 23:05:11.833357 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 23:05:11.882705 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:05:11.908916 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 23:05:12.458625 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 23:05:12.463671 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:05:12.474558 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:05:12.507872 tst handover.py: using LAC 17377 23:05:12.628161 tst handover.py: using RAC 37 23:05:12.753808 tst handover.py: using CellId 17377 23:05:12.874782 tst handover.py: using BVCI 17378 23:05:12.988139 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:05:13.034954 tst handover.py: using LAC 17378 23:05:13.154147 tst handover.py: using RAC 38 23:05:13.275350 tst handover.py: using CellId 17378 23:05:13.394648 tst handover.py: using BVCI 17379 23:05:13.507893 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:05:13.518789 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:05:13.529523 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:05:13.540464 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:05:13.551421 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:05:13.562409 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:05:13.680089 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:05:13.796238 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:05:14.243733 run create_hlr_db(pid=25495): Launched 23:05:14.359892 bus /sierra_2: Setting Powered False 23:05:15.420390 run create_hlr_db(pid=25495): Terminated: ok {rc=0} 23:05:15.849484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25497): Launched 23:05:16.199535 run osmo-hlr_10.42.42.2(pid=25498): Launched 23:05:16.453972 run osmo-stp_10.42.42.5: Starting osmo-stp 23:05:17.063192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25500): Launched 23:05:17.386803 run osmo-stp_10.42.42.5(pid=25501): Launched 23:05:17.505709 run osmo-msc_10.42.42.6: Starting osmo-msc 23:05:18.062552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25503): Launched 23:05:18.389608 run osmo-msc_10.42.42.6(pid=25504): Launched 23:05:18.572756 run osmo-stp_10.42.42.5(pid=25501): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25501)] 23:05:18.711365 run osmo-stp_10.42.42.5(pid=25501): stdout: | (launched: 2022-12-08_23:05:17.330463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:18.850830 run osmo-stp_10.42.42.5(pid=25501): stderr: | 20221208230517498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230517499 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230517499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230517499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230517502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230517502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230517502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:18.989455 run osmo-stp_10.42.42.5(pid=25501): stdout: | (launched: 2022-12-08_23:05:17.330463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:19.121429 run osmo-stp_10.42.42.5(pid=25501): stderr: | 20221208230517498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230517499 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230517499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230517499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230517502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230517502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230517502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:19.278214 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25501): Process ended prematurely: osmo-stp_10.42.42.5(pid=25501) [trial-2350↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25501)] [trial-2350↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 23:05:19.287348 tst handover.py:18: Test FAILED (6.8 sec) 23:05:19.315545 run osmo-hlr_10.42.42.2(pid=25498): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25498)] 23:05:19.367096 run osmo-hlr_10.42.42.2(pid=25498): stdout: | (launched: 2022-12-08_23:05:16.136344) 23:05:19.420281 run osmo-hlr_10.42.42.2(pid=25498): stderr: | 20221208230516446 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230516446 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230516446 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230516446 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230516446 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230516446 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230516463 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230516479 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230516479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230516480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:05:19.493705 run osmo-msc_10.42.42.6(pid=25504): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25504)] 23:05:19.544578 run osmo-msc_10.42.42.6(pid=25504): stdout: | (launched: 2022-12-08_23:05:18.329900) 23:05:19.597140 run osmo-msc_10.42.42.6(pid=25504): stderr: | 20221208230518653 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230518653 DLGLOBAL DEBUG validating counter group 0x7ff8befafc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230518653 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230518653 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230518653 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230518653 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230518655 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230518655 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230518656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230518656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:05:19.649929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25497): Terminating (SIGTERM) 23:05:19.692312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25500): Terminating (SIGTERM) 23:05:19.734855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25503): Terminating (SIGTERM) 23:05:19.777673 --- ParallelTerminationStrategy: PID 25497 died... 23:05:19.797905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25497): Terminated: ok {rc=0} 23:05:19.845562 --- ParallelTerminationStrategy: PID 25500 died... 23:05:19.865458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25500): Terminated: ok {rc=0} 23:05:19.912673 --- ParallelTerminationStrategy: PID 25503 died... 23:05:19.932730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25503): Terminated: ok {rc=0} 23:05:20.021886 bus /sierra_3: Setting Powered False 23:05:21.122581 bus /sierra_3: Setting Powered False 23:05:22.241969 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 23:05:23.500783 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:05:23.507363 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 23:05:23.544751 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 23:05:23.572016 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 23:05:23.627157 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 23:05:23.665474 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 23:05:23.692217 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 23:05:24.240151 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 23:05:24.246243 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:05:24.257919 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 23:05:24.292735 tst handover.py: using LAC 17379 23:05:24.422159 tst handover.py: using RAC 39 23:05:24.550587 tst handover.py: using CellId 17379 23:05:24.680612 tst handover.py: using BVCI 17380 23:05:24.799438 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 23:05:24.835439 tst handover.py: using LAC 17380 23:05:24.964925 tst handover.py: using RAC 40 23:05:25.094845 tst handover.py: using CellId 17380 23:05:25.224490 tst handover.py: using BVCI 17381 23:05:25.343343 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:05:25.354867 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:05:25.365885 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:05:25.377126 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:05:25.388289 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:05:25.399379 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 23:05:25.514649 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 23:05:25.632613 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:05:26.111258 run create_hlr_db(pid=25509): Launched 23:05:26.243974 bus /sierra_2: Setting Powered False 23:05:27.309556 run create_hlr_db(pid=25509): Terminated: ok {rc=0} 23:05:27.723158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25511): Launched 23:05:28.030188 run osmo-hlr_10.42.42.2(pid=25512): Launched 23:05:28.147026 run osmo-stp_10.42.42.5: Starting osmo-stp 23:05:28.666165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25514): Launched 23:05:28.970939 run osmo-stp_10.42.42.5(pid=25515): Launched 23:05:29.087961 run osmo-msc_10.42.42.6: Starting osmo-msc 23:05:29.615669 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25517): Launched 23:05:29.920790 run osmo-msc_10.42.42.6(pid=25518): Launched 23:05:30.091853 run osmo-stp_10.42.42.5(pid=25515): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25515)] 23:05:30.222652 run osmo-stp_10.42.42.5(pid=25515): stdout: | (launched: 2022-12-08_23:05:28.915481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:30.352942 run osmo-stp_10.42.42.5(pid=25515): stderr: | 20221208230529088 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230529088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230529088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230529089 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230529089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230529089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230529089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:30.480904 run osmo-stp_10.42.42.5(pid=25515): stdout: | (launched: 2022-12-08_23:05:28.915481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:30.603036 run osmo-stp_10.42.42.5(pid=25515): stderr: | 20221208230529088 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230529088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230529088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230529089 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230529089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230529089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230529089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:30.748453 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25515): Process ended prematurely: osmo-stp_10.42.42.5(pid=25515) [trial-2350↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25515)] [trial-2350↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 23:05:30.756924 tst handover.py:18: Test FAILED (6.5 sec) 23:05:30.783531 run osmo-hlr_10.42.42.2(pid=25512): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25512)] 23:05:30.832806 run osmo-hlr_10.42.42.2(pid=25512): stdout: | (launched: 2022-12-08_23:05:27.974487) 23:05:30.888838 run osmo-hlr_10.42.42.2(pid=25512): stderr: | 20221208230528149 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230528149 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230528149 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230528149 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230528150 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230528150 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230528162 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230528170 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230528171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230528171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:05:30.961541 run osmo-msc_10.42.42.6(pid=25518): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25518)] 23:05:31.012352 run osmo-msc_10.42.42.6(pid=25518): stdout: | (launched: 2022-12-08_23:05:29.865169) 23:05:31.064809 run osmo-msc_10.42.42.6(pid=25518): stderr: | 20221208230530137 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230530137 DLGLOBAL DEBUG validating counter group 0x7fa5586d3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230530137 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230530137 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230530137 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230530138 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230530140 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230530140 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230530140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230530140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:05:31.118055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25511): Terminating (SIGTERM) 23:05:31.161424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25514): Terminating (SIGTERM) 23:05:31.205595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25517): Terminating (SIGTERM) 23:05:31.248583 --- ParallelTerminationStrategy: PID 25511 died... 23:05:31.268556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25511): Terminated: ok {rc=0} 23:05:31.316504 --- ParallelTerminationStrategy: PID 25514 died... 23:05:31.336000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25514): Terminated: ok {rc=0} 23:05:31.384109 --- ParallelTerminationStrategy: PID 25517 died... 23:05:31.403839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25517): Terminated: ok {rc=0} 23:05:31.492516 bus /sierra_3: Setting Powered False 23:05:32.594623 bus /sierra_3: Setting Powered False 23:05:33.710198 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 23:05:34.951165 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:05:34.956545 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:05:35.005372 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:05:35.031582 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:05:35.087554 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:05:35.137459 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:05:35.163908 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:05:35.706460 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 23:05:35.711549 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:05:35.722294 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:05:35.754649 tst handover.py: using LAC 17381 23:05:35.874046 tst handover.py: using RAC 41 23:05:35.995321 tst handover.py: using CellId 17381 23:05:36.114154 tst handover.py: using BVCI 17382 23:05:36.226236 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:05:36.272526 tst handover.py: using LAC 17382 23:05:36.393441 tst handover.py: using RAC 42 23:05:36.525393 tst handover.py: using CellId 17382 23:05:36.653633 tst handover.py: using BVCI 17383 23:05:36.772620 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:05:36.784029 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:05:36.795143 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:05:36.806503 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:05:36.817700 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:05:36.828702 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:05:36.943397 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:05:37.060056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:05:37.541251 run create_hlr_db(pid=25523): Launched 23:05:37.673441 bus /sierra_2: Setting Powered False 23:05:38.738353 run create_hlr_db(pid=25523): Terminated: ok {rc=0} 23:05:39.151175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25525): Launched 23:05:39.459262 run osmo-hlr_10.42.42.2(pid=25526): Launched 23:05:39.577066 run osmo-stp_10.42.42.5: Starting osmo-stp 23:05:40.093116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25528): Launched 23:05:40.398806 run osmo-stp_10.42.42.5(pid=25529): Launched 23:05:40.515426 run osmo-msc_10.42.42.6: Starting osmo-msc 23:05:41.043260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25531): Launched 23:05:41.350645 run osmo-msc_10.42.42.6(pid=25532): Launched 23:05:41.522911 run osmo-stp_10.42.42.5(pid=25529): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25529)] 23:05:41.654307 run osmo-stp_10.42.42.5(pid=25529): stdout: | (launched: 2022-12-08_23:05:40.343205) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:41.784518 run osmo-stp_10.42.42.5(pid=25529): stderr: | 20221208230540514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230540514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230540515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230540515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230540515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230540516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230540516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:41.913355 run osmo-stp_10.42.42.5(pid=25529): stdout: | (launched: 2022-12-08_23:05:40.343205) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:42.035950 run osmo-stp_10.42.42.5(pid=25529): stderr: | 20221208230540514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230540514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230540515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230540515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230540515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230540516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230540516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:42.182576 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25529): Process ended prematurely: osmo-stp_10.42.42.5(pid=25529) [trial-2350↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25529)] [trial-2350↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 23:05:42.190845 tst handover.py:18: Test FAILED (6.5 sec) 23:05:42.217800 run osmo-hlr_10.42.42.2(pid=25526): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25526)] 23:05:42.267112 run osmo-hlr_10.42.42.2(pid=25526): stdout: | (launched: 2022-12-08_23:05:39.403246) 23:05:42.318306 run osmo-hlr_10.42.42.2(pid=25526): stderr: | 20221208230539579 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230539579 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230539579 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230539579 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230539579 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230539579 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230539591 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230539602 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230539602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230539602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:05:42.389234 run osmo-msc_10.42.42.6(pid=25532): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25532)] 23:05:42.438207 run osmo-msc_10.42.42.6(pid=25532): stdout: | (launched: 2022-12-08_23:05:41.294614) 23:05:42.489165 run osmo-msc_10.42.42.6(pid=25532): stderr: | 20221208230541564 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230541564 DLGLOBAL DEBUG validating counter group 0x7f2469b9ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230541564 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230541564 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230541565 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230541565 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230541567 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230541567 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230541567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230541567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:05:42.540229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25525): Terminating (SIGTERM) 23:05:42.581150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25528): Terminating (SIGTERM) 23:05:42.622162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25531): Terminating (SIGTERM) 23:05:42.663320 --- ParallelTerminationStrategy: PID 25525 died... 23:05:42.682795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25525): Terminated: ok {rc=0} 23:05:42.728526 --- ParallelTerminationStrategy: PID 25528 died... 23:05:42.747787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25528): Terminated: ok {rc=0} 23:05:42.793857 --- ParallelTerminationStrategy: PID 25531 died... 23:05:42.812871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25531): Terminated: ok {rc=0} 23:05:42.900536 bus /sierra_3: Setting Powered False 23:05:44.001725 bus /sierra_3: Setting Powered False 23:05:45.120220 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 23:05:46.387245 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:05:46.395455 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:05:46.460237 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:05:46.495596 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:05:46.559475 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:05:46.611110 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:05:46.640426 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:05:47.227567 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 23:05:47.233969 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:05:47.246379 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:05:47.285412 tst handover.py: using LAC 17383 23:05:47.414355 tst handover.py: using RAC 43 23:05:47.542451 tst handover.py: using CellId 17383 23:05:47.672128 tst handover.py: using BVCI 17384 23:05:47.791287 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:05:47.839792 tst handover.py: using LAC 17384 23:05:47.969440 tst handover.py: using RAC 44 23:05:48.098792 tst handover.py: using CellId 17384 23:05:48.228514 tst handover.py: using BVCI 17385 23:05:48.349390 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:05:48.360736 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:05:48.372375 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:05:48.383829 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:05:48.395336 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:05:48.406753 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:05:48.521838 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:05:48.639745 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:05:49.087382 run create_hlr_db(pid=25537): Launched 23:05:49.221521 bus /sierra_2: Setting Powered False 23:05:50.286745 run create_hlr_db(pid=25537): Terminated: ok {rc=0} 23:05:50.698575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25539): Launched 23:05:51.005741 run osmo-hlr_10.42.42.2(pid=25540): Launched 23:05:51.123188 run osmo-stp_10.42.42.5: Starting osmo-stp 23:05:51.628507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25542): Launched 23:05:51.934610 run osmo-stp_10.42.42.5(pid=25543): Launched 23:05:52.051358 run osmo-msc_10.42.42.6: Starting osmo-msc 23:05:52.579197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25545): Launched 23:05:52.885393 run osmo-msc_10.42.42.6(pid=25546): Launched 23:05:53.058038 run osmo-stp_10.42.42.5(pid=25543): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25543)] 23:05:53.189516 run osmo-stp_10.42.42.5(pid=25543): stdout: | (launched: 2022-12-08_23:05:51.878620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:53.320735 run osmo-stp_10.42.42.5(pid=25543): stderr: | 20221208230552049 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230552049 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230552049 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230552050 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230552050 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230552050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230552050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:53.449817 run osmo-stp_10.42.42.5(pid=25543): stdout: | (launched: 2022-12-08_23:05:51.878620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:53.572338 run osmo-stp_10.42.42.5(pid=25543): stderr: | 20221208230552049 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230552049 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230552049 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230552050 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230552050 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230552050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230552050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:53.719441 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25543): Process ended prematurely: osmo-stp_10.42.42.5(pid=25543) [trial-2350↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25543)] [trial-2350↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 23:05:53.727713 tst handover.py:18: Test FAILED (6.5 sec) 23:05:53.754418 run osmo-hlr_10.42.42.2(pid=25540): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25540)] 23:05:53.803576 run osmo-hlr_10.42.42.2(pid=25540): stdout: | (launched: 2022-12-08_23:05:50.949783) 23:05:53.854191 run osmo-hlr_10.42.42.2(pid=25540): stderr: | 20221208230551125 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230551125 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230551125 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230551125 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230551125 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230551126 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230551138 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230551146 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230551147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230551147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:05:53.924264 run osmo-msc_10.42.42.6(pid=25546): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25546)] 23:05:53.972738 run osmo-msc_10.42.42.6(pid=25546): stdout: | (launched: 2022-12-08_23:05:52.829288) 23:05:54.023090 run osmo-msc_10.42.42.6(pid=25546): stderr: | 20221208230553100 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230553100 DLGLOBAL DEBUG validating counter group 0x7f4a0b8f9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230553100 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230553100 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230553100 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230553101 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230553102 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230553103 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230553103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230553103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:05:54.073578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25539): Terminating (SIGTERM) 23:05:54.113825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25542): Terminating (SIGTERM) 23:05:54.154094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25545): Terminating (SIGTERM) 23:05:54.194483 --- ParallelTerminationStrategy: PID 25539 died... 23:05:54.213784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25539): Terminated: ok {rc=0} 23:05:54.261103 --- ParallelTerminationStrategy: PID 25542 died... 23:05:54.279753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25542): Terminated: ok {rc=0} 23:05:54.324688 --- ParallelTerminationStrategy: PID 25545 died... 23:05:54.343414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25545): Terminated: ok {rc=0} 23:05:54.429605 bus /sierra_3: Setting Powered False 23:05:55.528552 bus /sierra_3: Setting Powered False 23:05:56.646128 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 23:05:57.895797 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:05:57.900786 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 23:05:57.958328 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 23:05:57.984482 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 23:05:58.035656 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 23:05:58.093624 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 23:05:58.119869 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 23:05:58.671452 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 23:05:58.676564 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:58.687493 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:05:58.734557 tst handover.py: using LAC 17385 23:05:58.855798 tst handover.py: using RAC 45 23:05:58.977158 tst handover.py: using CellId 17385 23:05:59.096925 tst handover.py: using BVCI 17386 23:05:59.209428 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:05:59.252834 tst handover.py: using LAC 17386 23:05:59.373700 tst handover.py: using RAC 46 23:05:59.506556 tst handover.py: using CellId 17386 23:05:59.635118 tst handover.py: using BVCI 17387 23:05:59.755964 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:59.767635 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:59.779114 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:59.791323 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:59.803359 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:59.815330 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:05:59.932018 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:06:00.046934 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:06:00.494741 run create_hlr_db(pid=25553): Launched 23:06:00.611860 bus /sierra_2: Setting Powered False 23:06:01.682890 run create_hlr_db(pid=25553): Terminated: ok {rc=0} 23:06:02.098445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25555): Launched 23:06:02.413357 run osmo-hlr_10.42.42.2(pid=25556): Launched 23:06:02.530338 run osmo-stp_10.42.42.5: Starting osmo-stp 23:06:03.044824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25558): Launched 23:06:03.350822 run osmo-stp_10.42.42.5(pid=25559): Launched 23:06:03.467434 run osmo-msc_10.42.42.6: Starting osmo-msc 23:06:03.993797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25561): Launched 23:06:04.301497 run osmo-msc_10.42.42.6(pid=25562): Launched 23:06:04.473250 run osmo-stp_10.42.42.5(pid=25559): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25559)] 23:06:04.604310 run osmo-stp_10.42.42.5(pid=25559): stdout: | (launched: 2022-12-08_23:06:03.295192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:04.734899 run osmo-stp_10.42.42.5(pid=25559): stderr: | 20221208230603466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230603467 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230603467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230603467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230603468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230603468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230603468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:04.863765 run osmo-stp_10.42.42.5(pid=25559): stdout: | (launched: 2022-12-08_23:06:03.295192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:04.986233 run osmo-stp_10.42.42.5(pid=25559): stderr: | 20221208230603466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230603467 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230603467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230603467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230603468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230603468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230603468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:05.133081 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25559): Process ended prematurely: osmo-stp_10.42.42.5(pid=25559) [trial-2350↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25559)] [trial-2350↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 23:06:05.141382 tst handover.py:18: Test FAILED (6.5 sec) 23:06:05.167890 run osmo-hlr_10.42.42.2(pid=25556): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25556)] 23:06:05.216715 run osmo-hlr_10.42.42.2(pid=25556): stdout: | (launched: 2022-12-08_23:06:02.356780) 23:06:05.267023 run osmo-hlr_10.42.42.2(pid=25556): stderr: | 20221208230602534 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230602534 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230602534 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230602534 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230602534 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230602534 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230602546 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230602555 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230602555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230602555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:06:05.337138 run osmo-msc_10.42.42.6(pid=25562): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25562)] 23:06:05.385758 run osmo-msc_10.42.42.6(pid=25562): stdout: | (launched: 2022-12-08_23:06:04.245580) 23:06:05.436373 run osmo-msc_10.42.42.6(pid=25562): stderr: | 20221208230604518 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230604518 DLGLOBAL DEBUG validating counter group 0x7f4df1d17c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230604518 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230604518 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230604519 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230604519 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230604520 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230604521 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230604521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230604521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:06:05.487221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25555): Terminating (SIGTERM) 23:06:05.527492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25558): Terminating (SIGTERM) 23:06:05.567873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25561): Terminating (SIGTERM) 23:06:05.608570 --- ParallelTerminationStrategy: PID 25555 died... 23:06:05.627842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25555): Terminated: ok {rc=0} 23:06:05.673208 --- ParallelTerminationStrategy: PID 25558 died... 23:06:05.692090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25558): Terminated: ok {rc=0} 23:06:05.737433 --- ParallelTerminationStrategy: PID 25561 died... 23:06:05.756278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25561): Terminated: ok {rc=0} 23:06:05.843746 bus /sierra_3: Setting Powered False 23:06:06.942985 bus /sierra_3: Setting Powered False 23:06:08.059827 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 23:06:09.324456 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:06:09.331427 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 23:06:09.396705 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:06:09.424613 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 23:06:09.477503 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 23:06:09.542295 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:06:09.569785 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 23:06:10.121455 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 23:06:10.127038 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:10.138704 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:06:10.191181 tst handover.py: using LAC 17387 23:06:10.318971 tst handover.py: using RAC 47 23:06:10.439742 tst handover.py: using CellId 17387 23:06:10.558408 tst handover.py: using BVCI 17388 23:06:10.669981 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:06:10.717184 tst handover.py: using LAC 17388 23:06:10.836031 tst handover.py: using RAC 48 23:06:10.954772 tst handover.py: using CellId 17388 23:06:11.073590 tst handover.py: using BVCI 17389 23:06:11.187022 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:11.197930 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:11.208633 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:11.220199 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:11.231199 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:11.242279 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:06:11.360103 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:06:11.477219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:06:11.925662 run create_hlr_db(pid=25567): Launched 23:06:12.043048 bus /sierra_2: Setting Powered False 23:06:13.104572 run create_hlr_db(pid=25567): Terminated: ok {rc=0} 23:06:13.505662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25569): Launched 23:06:13.813201 run osmo-hlr_10.42.42.2(pid=25570): Launched 23:06:13.930512 run osmo-stp_10.42.42.5: Starting osmo-stp 23:06:14.434300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25572): Launched 23:06:14.738494 run osmo-stp_10.42.42.5(pid=25573): Launched 23:06:14.855286 run osmo-msc_10.42.42.6: Starting osmo-msc 23:06:15.382583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25575): Launched 23:06:15.689387 run osmo-msc_10.42.42.6(pid=25576): Launched 23:06:15.919997 run osmo-stp_10.42.42.5(pid=25573): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25573)] 23:06:16.180321 run osmo-stp_10.42.42.5(pid=25573): stdout: | (launched: 2022-12-08_23:06:14.682651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:16.416827 run osmo-stp_10.42.42.5(pid=25573): stderr: | 20221208230614851 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230614851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230614851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230614852 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230614854 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230614854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230614854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:16.590827 run osmo-stp_10.42.42.5(pid=25573): stdout: | (launched: 2022-12-08_23:06:14.682651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:16.717275 run osmo-stp_10.42.42.5(pid=25573): stderr: | 20221208230614851 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230614851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230614851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230614852 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230614854 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230614854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230614854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:16.867719 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25573): Process ended prematurely: osmo-stp_10.42.42.5(pid=25573) [trial-2350↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25573)] [trial-2350↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 23:06:16.876470 tst handover.py:18: Test FAILED (6.7 sec) 23:06:16.904156 run osmo-hlr_10.42.42.2(pid=25570): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25570)] 23:06:16.954203 run osmo-hlr_10.42.42.2(pid=25570): stdout: | (launched: 2022-12-08_23:06:13.756698) 23:06:17.005929 run osmo-hlr_10.42.42.2(pid=25570): stderr: | 20221208230613932 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230613932 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230613932 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230613932 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230613932 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230613932 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230613945 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230613953 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230613953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230613953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:06:17.078104 run osmo-msc_10.42.42.6(pid=25576): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25576)] 23:06:17.128058 run osmo-msc_10.42.42.6(pid=25576): stdout: | (launched: 2022-12-08_23:06:15.633388) 23:06:17.179695 run osmo-msc_10.42.42.6(pid=25576): stderr: | 20221208230615952 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230615953 DLGLOBAL DEBUG validating counter group 0x7f39ff968c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230615953 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230615953 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230615953 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230615953 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230615955 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230615955 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230615955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230615955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:06:17.231496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25569): Terminating (SIGTERM) 23:06:17.272905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25572): Terminating (SIGTERM) 23:06:17.314166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25575): Terminating (SIGTERM) 23:06:17.355693 --- ParallelTerminationStrategy: PID 25569 died... 23:06:17.375132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25569): Terminated: ok {rc=0} 23:06:17.421267 --- ParallelTerminationStrategy: PID 25572 died... 23:06:17.440625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25572): Terminated: ok {rc=0} 23:06:17.486180 --- ParallelTerminationStrategy: PID 25575 died... 23:06:17.505197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25575): Terminated: ok {rc=0} 23:06:17.591157 bus /sierra_3: Setting Powered False 23:06:18.690064 bus /sierra_3: Setting Powered False 23:06:19.808264 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 23:06:21.083117 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:06:21.088421 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 23:06:21.138240 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 23:06:21.164351 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 23:06:21.224008 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 23:06:21.275356 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 23:06:21.301635 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 23:06:21.846588 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 23:06:21.852656 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:06:21.864220 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 23:06:21.927172 tst handover.py: using LAC 17389 23:06:22.046330 tst handover.py: using RAC 49 23:06:22.167696 tst handover.py: using CellId 17389 23:06:22.287499 tst handover.py: using BVCI 17390 23:06:22.400722 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 23:06:22.434981 tst handover.py: using LAC 17390 23:06:22.562810 tst handover.py: using RAC 50 23:06:22.698102 tst handover.py: using CellId 17390 23:06:22.828800 tst handover.py: using BVCI 17391 23:06:22.947936 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:06:22.959300 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:06:22.970603 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:06:22.981627 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:06:22.992758 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:06:23.003790 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 23:06:23.121806 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 23:06:23.238763 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:06:23.687270 run create_hlr_db(pid=25581): Launched 23:06:23.804587 bus /sierra_2: Setting Powered False 23:06:24.866218 run create_hlr_db(pid=25581): Terminated: ok {rc=0} 23:06:25.285579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25583): Launched 23:06:25.616067 run osmo-hlr_10.42.42.2(pid=25584): Launched 23:06:25.740870 run osmo-stp_10.42.42.5: Starting osmo-stp 23:06:26.276122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25586): Launched 23:06:26.603347 run osmo-stp_10.42.42.5(pid=25587): Launched 23:06:26.727656 run osmo-msc_10.42.42.6: Starting osmo-msc 23:06:27.289718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25589): Launched 23:06:27.617435 run osmo-msc_10.42.42.6(pid=25590): Launched 23:06:27.799808 run osmo-stp_10.42.42.5(pid=25587): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25587)] 23:06:27.938844 run osmo-stp_10.42.42.5(pid=25587): stdout: | (launched: 2022-12-08_23:06:26.543987) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:28.078435 run osmo-stp_10.42.42.5(pid=25587): stderr: | 20221208230626738 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230626738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230626738 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230626738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230626739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230626739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230626739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:28.217138 run osmo-stp_10.42.42.5(pid=25587): stdout: | (launched: 2022-12-08_23:06:26.543987) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:28.347680 run osmo-stp_10.42.42.5(pid=25587): stderr: | 20221208230626738 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230626738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230626738 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230626738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230626739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230626739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230626739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:28.504646 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25587): Process ended prematurely: osmo-stp_10.42.42.5(pid=25587) [trial-2350↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25587)] [trial-2350↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 23:06:28.513809 tst handover.py:18: Test FAILED (6.7 sec) 23:06:28.541725 run osmo-hlr_10.42.42.2(pid=25584): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25584)] 23:06:28.592919 run osmo-hlr_10.42.42.2(pid=25584): stdout: | (launched: 2022-12-08_23:06:25.555352) 23:06:28.645885 run osmo-hlr_10.42.42.2(pid=25584): stderr: | 20221208230625756 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230625756 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230625756 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230625756 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230625756 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230625756 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230625769 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230625779 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230625779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230625779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:06:28.719678 run osmo-msc_10.42.42.6(pid=25590): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25590)] 23:06:28.770264 run osmo-msc_10.42.42.6(pid=25590): stdout: | (launched: 2022-12-08_23:06:27.557736) 23:06:28.822364 run osmo-msc_10.42.42.6(pid=25590): stderr: | 20221208230627879 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230627879 DLGLOBAL DEBUG validating counter group 0x7f301b28ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230627879 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230627879 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230627880 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230627880 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230627881 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230627882 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230627882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230627882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:06:28.874803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25583): Terminating (SIGTERM) 23:06:28.916735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25586): Terminating (SIGTERM) 23:06:28.959052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25589): Terminating (SIGTERM) 23:06:29.001630 --- ParallelTerminationStrategy: PID 25583 died... 23:06:29.021639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25583): Terminated: ok {rc=0} 23:06:29.068601 --- ParallelTerminationStrategy: PID 25586 died... 23:06:29.088505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25586): Terminated: ok {rc=0} 23:06:29.135233 --- ParallelTerminationStrategy: PID 25589 died... 23:06:29.155095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25589): Terminated: ok {rc=0} 23:06:29.243604 bus /sierra_3: Setting Powered False 23:06:30.341796 bus /sierra_3: Setting Powered False 23:06:31.462484 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 23:06:32.711982 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:06:32.717098 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:06:32.778585 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:06:32.804859 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:06:32.857638 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:06:32.920131 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:06:32.946450 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:06:33.493454 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 23:06:33.498475 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:06:33.509211 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:06:33.556276 tst handover.py: using LAC 17391 23:06:33.676638 tst handover.py: using RAC 51 23:06:33.799483 tst handover.py: using CellId 17391 23:06:33.922069 tst handover.py: using BVCI 17392 23:06:34.033334 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:06:34.081099 tst handover.py: using LAC 17392 23:06:34.202717 tst handover.py: using RAC 52 23:06:34.324484 tst handover.py: using CellId 17392 23:06:34.446820 tst handover.py: using BVCI 17393 23:06:34.559905 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:06:34.570619 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:06:34.581217 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:06:34.591969 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:06:34.602780 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:06:34.613629 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:06:34.731984 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:06:34.852399 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:06:35.331640 run create_hlr_db(pid=25595): Launched 23:06:35.466102 bus /sierra_2: Setting Powered False 23:06:36.530870 run create_hlr_db(pid=25595): Terminated: ok {rc=0} 23:06:36.941777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25597): Launched 23:06:37.247473 run osmo-hlr_10.42.42.2(pid=25598): Launched 23:06:37.364716 run osmo-stp_10.42.42.5: Starting osmo-stp 23:06:37.871800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25600): Launched 23:06:38.178548 run osmo-stp_10.42.42.5(pid=25601): Launched 23:06:38.296019 run osmo-msc_10.42.42.6: Starting osmo-msc 23:06:38.826810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25603): Launched 23:06:39.133176 run osmo-msc_10.42.42.6(pid=25604): Launched 23:06:39.304801 run osmo-stp_10.42.42.5(pid=25601): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25601)] 23:06:39.436225 run osmo-stp_10.42.42.5(pid=25601): stdout: | (launched: 2022-12-08_23:06:38.122659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:39.566819 run osmo-stp_10.42.42.5(pid=25601): stderr: | 20221208230638291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230638291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230638292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230638292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230638294 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230638295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230638295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:39.695710 run osmo-stp_10.42.42.5(pid=25601): stdout: | (launched: 2022-12-08_23:06:38.122659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:39.818185 run osmo-stp_10.42.42.5(pid=25601): stderr: | 20221208230638291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230638291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230638292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230638292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230638294 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230638295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230638295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:39.964369 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25601): Process ended prematurely: osmo-stp_10.42.42.5(pid=25601) [trial-2350↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25601)] [trial-2350↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 23:06:39.972619 tst handover.py:18: Test FAILED (6.5 sec) 23:06:39.999150 run osmo-hlr_10.42.42.2(pid=25598): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25598)] 23:06:40.047923 run osmo-hlr_10.42.42.2(pid=25598): stdout: | (launched: 2022-12-08_23:06:37.191853) 23:06:40.098376 run osmo-hlr_10.42.42.2(pid=25598): stderr: | 20221208230637368 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230637368 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230637368 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230637368 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230637368 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230637368 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230637380 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230637389 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230637389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230637389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:06:40.168419 run osmo-msc_10.42.42.6(pid=25604): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25604)] 23:06:40.216871 run osmo-msc_10.42.42.6(pid=25604): stdout: | (launched: 2022-12-08_23:06:39.077091) 23:06:40.266880 run osmo-msc_10.42.42.6(pid=25604): stderr: | 20221208230639348 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230639348 DLGLOBAL DEBUG validating counter group 0x7f0a8f5c1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230639348 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230639348 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230639348 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230639349 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230639350 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230639351 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230639351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230639351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:06:40.317578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25597): Terminating (SIGTERM) 23:06:40.357643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25600): Terminating (SIGTERM) 23:06:40.398012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25603): Terminating (SIGTERM) 23:06:40.438540 --- ParallelTerminationStrategy: PID 25597 died... 23:06:40.457747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25597): Terminated: ok {rc=0} 23:06:40.502487 --- ParallelTerminationStrategy: PID 25600 died... 23:06:40.521196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25600): Terminated: ok {rc=0} 23:06:40.566147 --- ParallelTerminationStrategy: PID 25603 died... 23:06:40.585069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25603): Terminated: ok {rc=0} 23:06:40.670161 bus /sierra_3: Setting Powered False 23:06:41.767898 bus /sierra_3: Setting Powered False 23:06:42.885459 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 23:06:44.160380 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:06:44.165962 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:06:44.231195 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:06:44.258408 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:06:44.310236 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:06:44.372348 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:06:44.399212 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:06:44.946741 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 23:06:44.951853 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:06:44.962771 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:06:45.011687 tst handover.py: using LAC 17393 23:06:45.131599 tst handover.py: using RAC 53 23:06:45.261317 tst handover.py: using CellId 17393 23:06:45.382257 tst handover.py: using BVCI 17394 23:06:45.496296 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:06:45.543096 tst handover.py: using LAC 17394 23:06:45.664572 tst handover.py: using RAC 54 23:06:45.784906 tst handover.py: using CellId 17394 23:06:45.923081 tst handover.py: using BVCI 17395 23:06:46.037630 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:06:46.049202 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:06:46.060251 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:06:46.072453 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:06:46.084503 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:06:46.097316 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:06:46.233858 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:06:46.372559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:06:46.877919 run create_hlr_db(pid=25609): Launched 23:06:47.045772 bus /sierra_2: Setting Powered False 23:06:48.106973 run create_hlr_db(pid=25609): Terminated: ok {rc=0} 23:06:48.526702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25611): Launched 23:06:48.854770 run osmo-hlr_10.42.42.2(pid=25612): Launched 23:06:48.979277 run osmo-stp_10.42.42.5: Starting osmo-stp 23:06:49.514786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25614): Launched 23:06:49.842848 run osmo-stp_10.42.42.5(pid=25615): Launched 23:06:49.967263 run osmo-msc_10.42.42.6: Starting osmo-msc 23:06:50.531353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25617): Launched 23:06:50.858483 run osmo-msc_10.42.42.6(pid=25618): Launched 23:06:51.039319 run osmo-stp_10.42.42.5(pid=25615): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25615)] 23:06:51.177669 run osmo-stp_10.42.42.5(pid=25615): stdout: | (launched: 2022-12-08_23:06:49.783329) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:51.316283 run osmo-stp_10.42.42.5(pid=25615): stderr: | 20221208230649973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230649974 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230649974 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230649974 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230649975 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230649975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230649975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:51.454496 run osmo-stp_10.42.42.5(pid=25615): stdout: | (launched: 2022-12-08_23:06:49.783329) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:51.585333 run osmo-stp_10.42.42.5(pid=25615): stderr: | 20221208230649973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230649974 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230649974 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230649974 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230649975 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230649975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230649975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:51.741141 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25615): Process ended prematurely: osmo-stp_10.42.42.5(pid=25615) [trial-2350↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25615)] [trial-2350↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 23:06:51.750282 tst handover.py:18: Test FAILED (6.8 sec) 23:06:51.778628 run osmo-hlr_10.42.42.2(pid=25612): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25612)] 23:06:51.829944 run osmo-hlr_10.42.42.2(pid=25612): stdout: | (launched: 2022-12-08_23:06:48.795446) 23:06:51.882678 run osmo-hlr_10.42.42.2(pid=25612): stderr: | 20221208230648994 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230648994 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230648994 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230648994 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230648994 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230648994 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230649006 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230649015 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230649016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230649016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:06:51.956272 run osmo-msc_10.42.42.6(pid=25618): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25618)] 23:06:52.007229 run osmo-msc_10.42.42.6(pid=25618): stdout: | (launched: 2022-12-08_23:06:50.799089) 23:06:52.059497 run osmo-msc_10.42.42.6(pid=25618): stderr: | 20221208230651120 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230651120 DLGLOBAL DEBUG validating counter group 0x7f70c0789c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230651121 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230651121 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230651121 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230651121 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230651123 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230651123 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230651123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230651123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:06:52.112431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25611): Terminating (SIGTERM) 23:06:52.154854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25614): Terminating (SIGTERM) 23:06:52.197189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25617): Terminating (SIGTERM) 23:06:52.239762 --- ParallelTerminationStrategy: PID 25611 died... 23:06:52.259822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25611): Terminated: ok {rc=0} 23:06:52.306768 --- ParallelTerminationStrategy: PID 25614 died... 23:06:52.326822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25614): Terminated: ok {rc=0} 23:06:52.373700 --- ParallelTerminationStrategy: PID 25617 died... 23:06:52.393563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25617): Terminated: ok {rc=0} 23:06:52.482541 bus /sierra_3: Setting Powered False 23:06:53.581698 bus /sierra_3: Setting Powered False 23:06:54.698124 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 23:06:55.966666 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:06:55.971845 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 23:06:56.030488 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:06:56.057019 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 23:06:56.112321 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 23:06:56.172529 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:06:56.199157 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 23:06:56.747199 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 23:06:56.752512 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:56.763566 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:06:56.807140 tst handover.py: using LAC 17395 23:06:56.928275 tst handover.py: using RAC 55 23:06:57.047186 tst handover.py: using CellId 17395 23:06:57.168043 tst handover.py: using BVCI 17396 23:06:57.279301 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:06:57.329922 tst handover.py: using LAC 17396 23:06:57.450312 tst handover.py: using RAC 56 23:06:57.571439 tst handover.py: using CellId 17396 23:06:57.690250 tst handover.py: using BVCI 17397 23:06:57.804273 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:57.815598 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:57.826725 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:57.838208 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:57.849666 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:57.861010 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:06:57.979156 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:06:58.094343 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:06:58.542855 run create_hlr_db(pid=25623): Launched 23:06:58.659954 bus /sierra_2: Setting Powered False 23:06:59.720305 run create_hlr_db(pid=25623): Terminated: ok {rc=0} 23:07:00.123038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25625): Launched 23:07:00.429046 run osmo-hlr_10.42.42.2(pid=25626): Launched 23:07:00.545951 run osmo-stp_10.42.42.5: Starting osmo-stp 23:07:01.109078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25628): Launched 23:07:01.461587 run osmo-stp_10.42.42.5(pid=25629): Launched 23:07:01.715192 run osmo-msc_10.42.42.6: Starting osmo-msc 23:07:02.358595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25631): Launched 23:07:02.687247 run osmo-msc_10.42.42.6(pid=25632): Launched 23:07:02.869739 run osmo-stp_10.42.42.5(pid=25629): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25629)] 23:07:03.008275 run osmo-stp_10.42.42.5(pid=25629): stdout: | (launched: 2022-12-08_23:07:01.398011) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:03.147316 run osmo-stp_10.42.42.5(pid=25629): stderr: | 20221208230701692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230701692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230701692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230701701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230701703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230701703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230701703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:03.285140 run osmo-stp_10.42.42.5(pid=25629): stdout: | (launched: 2022-12-08_23:07:01.398011) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:03.416173 run osmo-stp_10.42.42.5(pid=25629): stderr: | 20221208230701692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230701692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230701692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230701701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230701703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230701703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230701703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:03.572268 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25629): Process ended prematurely: osmo-stp_10.42.42.5(pid=25629) [trial-2350↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25629)] [trial-2350↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 23:07:03.581452 tst handover.py:18: Test FAILED (6.8 sec) 23:07:03.609369 run osmo-hlr_10.42.42.2(pid=25626): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25626)] 23:07:03.660224 run osmo-hlr_10.42.42.2(pid=25626): stdout: | (launched: 2022-12-08_23:07:00.373239) 23:07:03.712502 run osmo-hlr_10.42.42.2(pid=25626): stderr: | 20221208230700546 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230700546 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230700546 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230700546 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230700546 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230700546 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230700558 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230700566 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230700566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230700566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:07:03.785844 run osmo-msc_10.42.42.6(pid=25632): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25632)] 23:07:03.836639 run osmo-msc_10.42.42.6(pid=25632): stdout: | (launched: 2022-12-08_23:07:02.627737) 23:07:03.889229 run osmo-msc_10.42.42.6(pid=25632): stderr: | 20221208230702948 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230702948 DLGLOBAL DEBUG validating counter group 0x7fb963b34c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230702949 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230702949 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230702949 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230702949 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230702951 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230702951 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230702952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230702952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:07:03.941817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25625): Terminating (SIGTERM) 23:07:03.983814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25628): Terminating (SIGTERM) 23:07:04.026143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25631): Terminating (SIGTERM) 23:07:04.069000 --- ParallelTerminationStrategy: PID 25625 died... 23:07:04.089379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25625): Terminated: ok {rc=0} 23:07:04.136425 --- ParallelTerminationStrategy: PID 25628 died... 23:07:04.156338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25628): Terminated: ok {rc=0} 23:07:04.202974 --- ParallelTerminationStrategy: PID 25631 died... 23:07:04.222799 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25631): Terminated: ok {rc=0} 23:07:04.311319 bus /sierra_3: Setting Powered False 23:07:05.412180 bus /sierra_3: Setting Powered False 23:07:06.530826 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 23:07:07.798224 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:07:07.804877 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 23:07:07.852788 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 23:07:07.880195 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 23:07:07.932892 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 23:07:07.980224 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 23:07:08.007645 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 23:07:08.559884 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 23:07:08.565513 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:08.577314 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 23:07:08.621623 tst handover.py: using LAC 17397 23:07:08.750252 tst handover.py: using RAC 57 23:07:08.880396 tst handover.py: using CellId 17397 23:07:09.008763 tst handover.py: using BVCI 17398 23:07:09.127514 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 23:07:09.164384 tst handover.py: using LAC 17398 23:07:09.293370 tst handover.py: using RAC 58 23:07:09.421809 tst handover.py: using CellId 17398 23:07:09.549562 tst handover.py: using BVCI 17399 23:07:09.668228 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:09.679823 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:09.691149 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:09.702677 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:09.714120 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:09.725414 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 23:07:09.840805 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 23:07:09.956087 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:07:10.403577 run create_hlr_db(pid=25638): Launched 23:07:10.521345 bus /sierra_2: Setting Powered False 23:07:11.582325 run create_hlr_db(pid=25638): Terminated: ok {rc=0} 23:07:12.001511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25640): Launched 23:07:12.329835 run osmo-hlr_10.42.42.2(pid=25641): Launched 23:07:12.455293 run osmo-stp_10.42.42.5: Starting osmo-stp 23:07:12.988496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25643): Launched 23:07:13.314894 run osmo-stp_10.42.42.5(pid=25644): Launched 23:07:13.439789 run osmo-msc_10.42.42.6: Starting osmo-msc 23:07:14.002280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25646): Launched 23:07:14.329529 run osmo-msc_10.42.42.6(pid=25647): Launched 23:07:14.512896 run osmo-stp_10.42.42.5(pid=25644): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25644)] 23:07:14.652835 run osmo-stp_10.42.42.5(pid=25644): stdout: | (launched: 2022-12-08_23:07:13.255600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:14.791889 run osmo-stp_10.42.42.5(pid=25644): stderr: | 20221208230713450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230713450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230713450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230713451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230713451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230713451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230713451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:14.929988 run osmo-stp_10.42.42.5(pid=25644): stdout: | (launched: 2022-12-08_23:07:13.255600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:15.061048 run osmo-stp_10.42.42.5(pid=25644): stderr: | 20221208230713450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230713450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230713450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230713451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230713451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230713451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230713451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:15.217923 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25644): Process ended prematurely: osmo-stp_10.42.42.5(pid=25644) [trial-2350↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25644)] [trial-2350↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 23:07:15.226923 tst handover.py:18: Test FAILED (6.7 sec) 23:07:15.254716 run osmo-hlr_10.42.42.2(pid=25641): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25641)] 23:07:15.305325 run osmo-hlr_10.42.42.2(pid=25641): stdout: | (launched: 2022-12-08_23:07:12.270486) 23:07:15.357907 run osmo-hlr_10.42.42.2(pid=25641): stderr: | 20221208230712470 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230712470 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230712470 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230712470 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230712470 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230712470 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230712483 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230712491 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230712491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230712491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:07:15.431298 run osmo-msc_10.42.42.6(pid=25647): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25647)] 23:07:15.481835 run osmo-msc_10.42.42.6(pid=25647): stdout: | (launched: 2022-12-08_23:07:14.270072) 23:07:15.534243 run osmo-msc_10.42.42.6(pid=25647): stderr: | 20221208230714592 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230714592 DLGLOBAL DEBUG validating counter group 0x7fdc63a9ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230714593 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230714593 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230714593 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230714593 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230714595 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230714595 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230714596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230714596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:07:15.586641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25640): Terminating (SIGTERM) 23:07:15.628560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25643): Terminating (SIGTERM) 23:07:15.670931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25646): Terminating (SIGTERM) 23:07:15.713386 --- ParallelTerminationStrategy: PID 25640 died... 23:07:15.733616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25640): Terminated: ok {rc=0} 23:07:15.780585 --- ParallelTerminationStrategy: PID 25643 died... 23:07:15.800248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25643): Terminated: ok {rc=0} 23:07:15.853876 --- ParallelTerminationStrategy: PID 25646 died... 23:07:15.877364 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25646): Terminated: ok {rc=0} 23:07:15.974668 bus /sierra_3: Setting Powered False 23:07:17.080443 bus /sierra_3: Setting Powered False 23:07:18.199642 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 23:07:19.451490 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:07:19.456488 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:07:19.513911 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:07:19.540246 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:07:19.591132 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:07:19.648759 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:07:19.674929 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:07:20.226011 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 23:07:20.231079 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:20.242082 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:07:20.285361 tst handover.py: using LAC 17399 23:07:20.404658 tst handover.py: using RAC 59 23:07:20.525370 tst handover.py: using CellId 17399 23:07:20.646799 tst handover.py: using BVCI 17400 23:07:20.759745 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:07:20.807689 tst handover.py: using LAC 17400 23:07:20.930226 tst handover.py: using RAC 60 23:07:21.060799 tst handover.py: using CellId 17400 23:07:21.190018 tst handover.py: using BVCI 17401 23:07:21.309488 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:21.321186 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:21.332681 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:21.344864 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:21.357044 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:21.369099 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:07:21.489340 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:07:21.609667 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:07:22.058456 run create_hlr_db(pid=25652): Launched 23:07:22.176549 bus /sierra_2: Setting Powered False 23:07:23.237995 run create_hlr_db(pid=25652): Terminated: ok {rc=0} 23:07:23.639117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25654): Launched 23:07:23.945142 run osmo-hlr_10.42.42.2(pid=25655): Launched 23:07:24.063096 run osmo-stp_10.42.42.5: Starting osmo-stp 23:07:24.574477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25657): Launched 23:07:24.880435 run osmo-stp_10.42.42.5(pid=25658): Launched 23:07:24.997802 run osmo-msc_10.42.42.6: Starting osmo-msc 23:07:25.526362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25660): Launched 23:07:25.833205 run osmo-msc_10.42.42.6(pid=25661): Launched 23:07:26.004452 run osmo-stp_10.42.42.5(pid=25658): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25658)] 23:07:26.135244 run osmo-stp_10.42.42.5(pid=25658): stdout: | (launched: 2022-12-08_23:07:24.824508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:26.265552 run osmo-stp_10.42.42.5(pid=25658): stderr: | 20221208230724995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230724995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230724995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230724995 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230724996 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230724996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230724996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:26.394614 run osmo-stp_10.42.42.5(pid=25658): stdout: | (launched: 2022-12-08_23:07:24.824508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:26.516620 run osmo-stp_10.42.42.5(pid=25658): stderr: | 20221208230724995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230724995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230724995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230724995 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230724996 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230724996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230724996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:26.662587 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25658): Process ended prematurely: osmo-stp_10.42.42.5(pid=25658) [trial-2350↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25658)] [trial-2350↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 23:07:26.670781 tst handover.py:18: Test FAILED (6.4 sec) 23:07:26.697530 run osmo-hlr_10.42.42.2(pid=25655): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25655)] 23:07:26.746340 run osmo-hlr_10.42.42.2(pid=25655): stdout: | (launched: 2022-12-08_23:07:23.889308) 23:07:26.796612 run osmo-hlr_10.42.42.2(pid=25655): stderr: | 20221208230724066 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230724066 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230724066 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230724066 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230724066 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230724066 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230724078 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230724086 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230724087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230724087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:07:26.866761 run osmo-msc_10.42.42.6(pid=25661): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25661)] 23:07:26.915006 run osmo-msc_10.42.42.6(pid=25661): stdout: | (launched: 2022-12-08_23:07:25.776655) 23:07:26.964860 run osmo-msc_10.42.42.6(pid=25661): stderr: | 20221208230726049 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230726049 DLGLOBAL DEBUG validating counter group 0x7f843ef2bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230726049 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230726049 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230726050 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230726050 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230726051 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230726052 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230726052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230726052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:07:27.015047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25654): Terminating (SIGTERM) 23:07:27.055431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25657): Terminating (SIGTERM) 23:07:27.095833 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25660): Terminating (SIGTERM) 23:07:27.136406 --- ParallelTerminationStrategy: PID 25654 died... 23:07:27.155704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25654): Terminated: ok {rc=0} 23:07:27.200722 --- ParallelTerminationStrategy: PID 25657 died... 23:07:27.219630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25657): Terminated: ok {rc=0} 23:07:27.264701 --- ParallelTerminationStrategy: PID 25660 died... 23:07:27.283584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25660): Terminated: ok {rc=0} 23:07:27.370249 bus /sierra_3: Setting Powered False 23:07:28.471528 bus /sierra_3: Setting Powered False 23:07:29.588751 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 23:07:30.861655 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:07:30.867698 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:07:30.953528 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:07:30.981471 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:07:31.036315 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:07:31.097162 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:07:31.125244 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:07:31.675897 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 23:07:31.681699 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:07:31.693992 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:07:31.738197 tst handover.py: using LAC 17401 23:07:31.862450 tst handover.py: using RAC 61 23:07:32.025090 tst handover.py: using CellId 17401 23:07:32.161848 tst handover.py: using BVCI 17402 23:07:32.298142 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:07:32.346895 tst handover.py: using LAC 17402 23:07:32.476840 tst handover.py: using RAC 62 23:07:32.605565 tst handover.py: using CellId 17402 23:07:32.732828 tst handover.py: using BVCI 17403 23:07:32.851790 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:07:32.863519 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:07:32.875039 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:07:32.886519 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:07:32.897829 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:07:32.909279 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:07:33.025987 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:07:33.140928 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:07:33.592171 run create_hlr_db(pid=25666): Launched 23:07:33.710510 bus /sierra_2: Setting Powered False 23:07:34.772904 run create_hlr_db(pid=25666): Terminated: ok {rc=0} 23:07:35.175571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25668): Launched 23:07:35.483010 run osmo-hlr_10.42.42.2(pid=25669): Launched 23:07:35.600463 run osmo-stp_10.42.42.5: Starting osmo-stp 23:07:36.110793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25672): Launched 23:07:36.417092 run osmo-stp_10.42.42.5(pid=25673): Launched 23:07:36.534851 run osmo-msc_10.42.42.6: Starting osmo-msc 23:07:37.061719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25675): Launched 23:07:37.367658 run osmo-msc_10.42.42.6(pid=25676): Launched 23:07:37.538459 run osmo-stp_10.42.42.5(pid=25673): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25673)] 23:07:37.670330 run osmo-stp_10.42.42.5(pid=25673): stdout: | (launched: 2022-12-08_23:07:36.360823) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:37.800135 run osmo-stp_10.42.42.5(pid=25673): stderr: | 20221208230736530 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230736531 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230736531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230736531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230736532 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230736532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230736532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:37.928432 run osmo-stp_10.42.42.5(pid=25673): stdout: | (launched: 2022-12-08_23:07:36.360823) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:38.050057 run osmo-stp_10.42.42.5(pid=25673): stderr: | 20221208230736530 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230736531 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230736531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230736531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230736532 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230736532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230736532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:38.196904 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25673): Process ended prematurely: osmo-stp_10.42.42.5(pid=25673) [trial-2350↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25673)] [trial-2350↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 23:07:38.205146 tst handover.py:18: Test FAILED (6.5 sec) 23:07:38.232090 run osmo-hlr_10.42.42.2(pid=25669): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25669)] 23:07:38.280697 run osmo-hlr_10.42.42.2(pid=25669): stdout: | (launched: 2022-12-08_23:07:35.426581) 23:07:38.330985 run osmo-hlr_10.42.42.2(pid=25669): stderr: | 20221208230735603 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230735603 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230735604 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230735604 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230735604 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230735604 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230735616 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230735624 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230735624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230735624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:07:38.400880 run osmo-msc_10.42.42.6(pid=25676): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25676)] 23:07:38.449398 run osmo-msc_10.42.42.6(pid=25676): stdout: | (launched: 2022-12-08_23:07:37.311416) 23:07:38.499399 run osmo-msc_10.42.42.6(pid=25676): stderr: | 20221208230737582 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230737582 DLGLOBAL DEBUG validating counter group 0x7fce3cdd0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230737582 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230737582 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230737583 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230737583 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230737585 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230737585 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230737585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230737585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:07:38.549819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25668): Terminating (SIGTERM) 23:07:38.590037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25672): Terminating (SIGTERM) 23:07:38.630184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25675): Terminating (SIGTERM) 23:07:38.670636 --- ParallelTerminationStrategy: PID 25668 died... 23:07:38.689906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25668): Terminated: ok {rc=0} 23:07:38.734909 --- ParallelTerminationStrategy: PID 25672 died... 23:07:38.753688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25672): Terminated: ok {rc=0} 23:07:38.798607 --- ParallelTerminationStrategy: PID 25675 died... 23:07:38.817585 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25675): Terminated: ok {rc=0} 23:07:38.905454 bus /sierra_3: Setting Powered False 23:07:40.005278 bus /sierra_3: Setting Powered False 23:07:41.122015 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 23:07:42.381350 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:07:42.386362 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 23:07:42.436382 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 23:07:42.462590 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 23:07:42.511359 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 23:07:42.561498 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 23:07:42.587633 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 23:07:43.140748 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 23:07:43.148378 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:43.160428 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 23:07:43.211976 tst handover.py: using LAC 17403 23:07:43.338844 tst handover.py: using RAC 63 23:07:43.466360 tst handover.py: using CellId 17403 23:07:43.593081 tst handover.py: using BVCI 17404 23:07:43.712255 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 23:07:43.746536 tst handover.py: using LAC 17404 23:07:43.867588 tst handover.py: using RAC 64 23:07:44.000819 tst handover.py: using CellId 17404 23:07:44.129369 tst handover.py: using BVCI 17405 23:07:44.251082 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:44.262651 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:44.274089 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:44.285525 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:44.297005 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:44.308253 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 23:07:44.423550 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 23:07:44.540483 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:07:44.990687 run create_hlr_db(pid=25681): Launched 23:07:45.108352 bus /sierra_2: Setting Powered False 23:07:46.168188 run create_hlr_db(pid=25681): Terminated: ok {rc=0} 23:07:46.580654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25683): Launched 23:07:46.994887 run osmo-hlr_10.42.42.2(pid=25684): Launched 23:07:47.211117 run osmo-stp_10.42.42.5: Starting osmo-stp 23:07:47.758773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25686): Launched 23:07:48.065334 run osmo-stp_10.42.42.5(pid=25687): Launched 23:07:48.182204 run osmo-msc_10.42.42.6: Starting osmo-msc 23:07:48.709565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25689): Launched 23:07:49.017849 run osmo-msc_10.42.42.6(pid=25690): Launched 23:07:49.188893 run osmo-stp_10.42.42.5(pid=25687): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25687)] 23:07:49.319097 run osmo-stp_10.42.42.5(pid=25687): stdout: | (launched: 2022-12-08_23:07:48.009393) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:49.449575 run osmo-stp_10.42.42.5(pid=25687): stderr: | 20221208230748179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230748179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230748179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230748180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230748180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230748180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230748180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:49.578507 run osmo-stp_10.42.42.5(pid=25687): stdout: | (launched: 2022-12-08_23:07:48.009393) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:49.701255 run osmo-stp_10.42.42.5(pid=25687): stderr: | 20221208230748179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230748179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230748179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230748180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230748180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230748180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230748180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:49.848075 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25687): Process ended prematurely: osmo-stp_10.42.42.5(pid=25687) [trial-2350↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25687)] [trial-2350↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 23:07:49.856326 tst handover.py:18: Test FAILED (6.7 sec) 23:07:49.883182 run osmo-hlr_10.42.42.2(pid=25684): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25684)] 23:07:49.931852 run osmo-hlr_10.42.42.2(pid=25684): stdout: | (launched: 2022-12-08_23:07:46.931943) 23:07:49.982723 run osmo-hlr_10.42.42.2(pid=25684): stderr: | 20221208230747233 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230747233 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230747233 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230747233 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230747234 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230747234 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230747252 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230747260 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230747260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230747260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:07:50.053415 run osmo-msc_10.42.42.6(pid=25690): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25690)] 23:07:50.102158 run osmo-msc_10.42.42.6(pid=25690): stdout: | (launched: 2022-12-08_23:07:48.961250) 23:07:50.152596 run osmo-msc_10.42.42.6(pid=25690): stderr: | 20221208230749231 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230749232 DLGLOBAL DEBUG validating counter group 0x7febc94f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230749232 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230749232 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230749232 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230749232 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230749234 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230749234 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230749235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230749235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:07:50.203661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25683): Terminating (SIGTERM) 23:07:50.244542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25686): Terminating (SIGTERM) 23:07:50.285436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25689): Terminating (SIGTERM) 23:07:50.326456 --- ParallelTerminationStrategy: PID 25683 died... 23:07:50.345881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25683): Terminated: ok {rc=0} 23:07:50.391524 --- ParallelTerminationStrategy: PID 25686 died... 23:07:50.410510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25686): Terminated: ok {rc=0} 23:07:50.455790 --- ParallelTerminationStrategy: PID 25689 died... 23:07:50.474780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25689): Terminated: ok {rc=0} 23:07:50.560008 bus /sierra_3: Setting Powered False 23:07:51.657830 bus /sierra_3: Setting Powered False 23:07:52.771898 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 23:07:54.022796 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:07:54.030108 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:07:54.096599 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:07:54.124001 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:07:54.178401 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:07:54.246877 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:07:54.274374 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:07:54.820812 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 23:07:54.826314 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:54.837886 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:07:54.887865 tst handover.py: using LAC 17405 23:07:55.017293 tst handover.py: using RAC 65 23:07:55.139203 tst handover.py: using CellId 17405 23:07:55.275249 tst handover.py: using BVCI 17406 23:07:55.389190 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:07:55.440428 tst handover.py: using LAC 17406 23:07:55.571156 tst handover.py: using RAC 66 23:07:55.701982 tst handover.py: using CellId 17406 23:07:55.824409 tst handover.py: using BVCI 17407 23:07:55.938250 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:55.949217 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:55.959875 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:55.970868 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:55.981813 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:55.992792 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:07:56.111768 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:07:56.231136 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:07:56.711996 run create_hlr_db(pid=25695): Launched 23:07:56.845851 bus /sierra_2: Setting Powered False 23:07:57.911042 run create_hlr_db(pid=25695): Terminated: ok {rc=0} 23:07:58.324017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25697): Launched 23:07:58.653738 run osmo-hlr_10.42.42.2(pid=25698): Launched 23:07:58.779626 run osmo-stp_10.42.42.5: Starting osmo-stp 23:07:59.318844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25700): Launched 23:07:59.646317 run osmo-stp_10.42.42.5(pid=25701): Launched 23:07:59.771222 run osmo-msc_10.42.42.6: Starting osmo-msc 23:08:00.335127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25703): Launched 23:08:00.662939 run osmo-msc_10.42.42.6(pid=25704): Launched 23:08:00.890361 run osmo-stp_10.42.42.5(pid=25701): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25701)] 23:08:01.181622 run osmo-stp_10.42.42.5(pid=25701): stdout: | (launched: 2022-12-08_23:07:59.587071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:01.408245 run osmo-stp_10.42.42.5(pid=25701): stderr: | 20221208230759779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230759779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230759779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230759779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230759780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230759780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230759780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:01.560873 run osmo-stp_10.42.42.5(pid=25701): stdout: | (launched: 2022-12-08_23:07:59.587071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:01.692880 run osmo-stp_10.42.42.5(pid=25701): stderr: | 20221208230759779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230759779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230759779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230759779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230759780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230759780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230759780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:01.844747 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25701): Process ended prematurely: osmo-stp_10.42.42.5(pid=25701) [trial-2350↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25701)] [trial-2350↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 23:08:01.854176 tst handover.py:18: Test FAILED (7.0 sec) 23:08:01.884788 run osmo-hlr_10.42.42.2(pid=25698): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25698)] 23:08:01.940904 run osmo-hlr_10.42.42.2(pid=25698): stdout: | (launched: 2022-12-08_23:07:58.594657) 23:08:02.006358 run osmo-hlr_10.42.42.2(pid=25698): stderr: | 20221208230758793 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230758793 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230758793 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230758793 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230758793 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230758793 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230758805 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230758815 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230758815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230758815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:08:02.081877 run osmo-msc_10.42.42.6(pid=25704): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25704)] 23:08:02.141641 run osmo-msc_10.42.42.6(pid=25704): stdout: | (launched: 2022-12-08_23:08:00.603584) 23:08:02.196280 run osmo-msc_10.42.42.6(pid=25704): stderr: | 20221208230800955 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230800955 DLGLOBAL DEBUG validating counter group 0x7f76192ccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230800955 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230800956 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230800956 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230800956 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230800958 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230800958 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230800958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230800959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:08:02.250715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25697): Terminating (SIGTERM) 23:08:02.293683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25700): Terminating (SIGTERM) 23:08:02.337401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25703): Terminating (SIGTERM) 23:08:02.382589 --- ParallelTerminationStrategy: PID 25697 died... 23:08:02.404544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25697): Terminated: ok {rc=0} 23:08:02.459330 --- ParallelTerminationStrategy: PID 25700 died... 23:08:02.486016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25700): Terminated: ok {rc=0} 23:08:02.535612 --- ParallelTerminationStrategy: PID 25703 died... 23:08:02.560292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25703): Terminated: ok {rc=0} 23:08:02.665156 bus /sierra_3: Setting Powered False 23:08:03.790656 bus /sierra_3: Setting Powered False 23:08:04.941639 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 23:08:06.232397 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:08:06.238917 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:08:06.303926 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:08:06.332334 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:08:06.385228 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:08:06.452549 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:08:06.481598 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:08:07.030321 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 23:08:07.037168 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:07.049485 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:08:07.100752 tst handover.py: using LAC 17407 23:08:07.236811 tst handover.py: using RAC 67 23:08:07.368863 tst handover.py: using CellId 17407 23:08:07.499844 tst handover.py: using BVCI 17408 23:08:07.622699 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:08:07.670414 tst handover.py: using LAC 17408 23:08:07.798320 tst handover.py: using RAC 68 23:08:07.926896 tst handover.py: using CellId 17408 23:08:08.056318 tst handover.py: using BVCI 17409 23:08:08.178262 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:08.190675 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:08.202583 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:08.214659 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:08.227442 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:08.239415 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:08:08.361892 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:08:08.485649 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:08:08.979033 run create_hlr_db(pid=25981): Launched 23:08:09.149351 bus /sierra_2: Setting Powered False 23:08:10.217933 run create_hlr_db(pid=25981): Terminated: ok {rc=0} 23:08:10.663395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25983): Launched 23:08:11.016495 run osmo-hlr_10.42.42.2(pid=25984): Launched 23:08:11.273983 run osmo-stp_10.42.42.5: Starting osmo-stp 23:08:11.943808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25986): Launched 23:08:12.271776 run osmo-stp_10.42.42.5(pid=25987): Launched 23:08:12.511182 run osmo-msc_10.42.42.6: Starting osmo-msc 23:08:13.214731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25989): Launched 23:08:13.543868 run osmo-msc_10.42.42.6(pid=25990): Launched 23:08:13.894594 run osmo-stp_10.42.42.5(pid=25987): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25987)] 23:08:14.178295 run osmo-stp_10.42.42.5(pid=25987): stdout: | (launched: 2022-12-08_23:08:12.212297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:14.386891 run osmo-stp_10.42.42.5(pid=25987): stderr: | 20221208230812545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230812546 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230812546 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230812546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230812547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230812547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230812547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:14.530491 run osmo-stp_10.42.42.5(pid=25987): stdout: | (launched: 2022-12-08_23:08:12.212297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:14.666577 run osmo-stp_10.42.42.5(pid=25987): stderr: | 20221208230812545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230812546 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230812546 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230812546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230812547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230812547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230812547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:14.827655 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25987): Process ended prematurely: osmo-stp_10.42.42.5(pid=25987) [trial-2350↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25987)] [trial-2350↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 23:08:14.837947 tst handover.py:18: Test FAILED (7.8 sec) 23:08:14.867291 run osmo-hlr_10.42.42.2(pid=25984): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25984)] 23:08:14.920066 run osmo-hlr_10.42.42.2(pid=25984): stdout: | (launched: 2022-12-08_23:08:10.948367) 23:08:14.974684 run osmo-hlr_10.42.42.2(pid=25984): stderr: | 20221208230811269 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230811269 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230811269 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230811269 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230811269 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230811269 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230811288 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230811300 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230811309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230811309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:08:15.052074 run osmo-msc_10.42.42.6(pid=25990): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25990)] 23:08:15.105568 run osmo-msc_10.42.42.6(pid=25990): stdout: | (launched: 2022-12-08_23:08:13.483109) 23:08:15.159822 run osmo-msc_10.42.42.6(pid=25990): stderr: | 20221208230814080 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230814080 DLGLOBAL DEBUG validating counter group 0x7f92f60cac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230814080 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230814080 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230814081 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230814081 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230814083 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230814083 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230814083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230814083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:08:15.216718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25983): Terminating (SIGTERM) 23:08:15.261818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25986): Terminating (SIGTERM) 23:08:15.307950 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25989): Terminating (SIGTERM) 23:08:15.355121 --- ParallelTerminationStrategy: PID 25983 died... 23:08:15.376234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25983): Terminated: ok {rc=0} 23:08:15.427896 --- ParallelTerminationStrategy: PID 25986 died... 23:08:15.449336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25986): Terminated: ok {rc=0} 23:08:15.498308 --- ParallelTerminationStrategy: PID 25989 died... 23:08:15.519250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25989): Terminated: ok {rc=0} 23:08:15.611953 bus /sierra_3: Setting Powered False 23:08:16.746993 bus /sierra_3: Setting Powered False 23:08:17.892730 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 23:08:19.178680 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:08:19.185288 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:08:19.239484 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:08:19.267637 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:08:19.325697 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:08:19.379363 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:08:19.408553 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:08:19.957403 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 23:08:19.964235 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:08:19.976428 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:08:20.014161 tst handover.py: using LAC 17409 23:08:20.144236 tst handover.py: using RAC 69 23:08:20.276495 tst handover.py: using CellId 17409 23:08:20.405845 tst handover.py: using BVCI 17410 23:08:20.531227 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:08:20.583195 tst handover.py: using LAC 17410 23:08:20.714493 tst handover.py: using RAC 70 23:08:20.846189 tst handover.py: using CellId 17410 23:08:20.975987 tst handover.py: using BVCI 17411 23:08:21.100156 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:08:21.112887 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:08:21.124852 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:08:21.137440 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:08:21.149187 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:08:21.161866 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:08:21.286835 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:08:21.412056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:08:21.912785 run create_hlr_db(pid=25995): Launched 23:08:22.085754 bus /sierra_2: Setting Powered False 23:08:23.151865 run create_hlr_db(pid=25995): Terminated: ok {rc=0} 23:08:23.599294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25997): Launched 23:08:23.953095 run osmo-hlr_10.42.42.2(pid=25998): Launched 23:08:24.213445 run osmo-stp_10.42.42.5: Starting osmo-stp 23:08:24.859439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26000): Launched 23:08:25.165795 run osmo-stp_10.42.42.5(pid=26001): Launched 23:08:25.282290 run osmo-msc_10.42.42.6: Starting osmo-msc 23:08:25.809581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26003): Launched 23:08:26.117976 run osmo-msc_10.42.42.6(pid=26004): Launched 23:08:26.289154 run osmo-stp_10.42.42.5(pid=26001): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26001)] 23:08:26.420550 run osmo-stp_10.42.42.5(pid=26001): stdout: | (launched: 2022-12-08_23:08:25.109761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:26.551831 run osmo-stp_10.42.42.5(pid=26001): stderr: | 20221208230825280 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230825280 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230825281 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230825281 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230825282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230825282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230825282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:26.680099 run osmo-stp_10.42.42.5(pid=26001): stdout: | (launched: 2022-12-08_23:08:25.109761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:26.802610 run osmo-stp_10.42.42.5(pid=26001): stderr: | 20221208230825280 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230825280 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230825281 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230825281 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230825282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230825282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230825282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:26.948792 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26001): Process ended prematurely: osmo-stp_10.42.42.5(pid=26001) [trial-2350↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26001)] [trial-2350↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 23:08:26.957126 tst handover.py:18: Test FAILED (7.0 sec) 23:08:26.984221 run osmo-hlr_10.42.42.2(pid=25998): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25998)] 23:08:27.033254 run osmo-hlr_10.42.42.2(pid=25998): stdout: | (launched: 2022-12-08_23:08:23.887578) 23:08:27.083898 run osmo-hlr_10.42.42.2(pid=25998): stderr: | 20221208230824205 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230824206 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230824206 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230824206 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230824206 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230824206 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230824227 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230824239 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230824239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230824240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:08:27.154815 run osmo-msc_10.42.42.6(pid=26004): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26004)] 23:08:27.203831 run osmo-msc_10.42.42.6(pid=26004): stdout: | (launched: 2022-12-08_23:08:26.061790) 23:08:27.254352 run osmo-msc_10.42.42.6(pid=26004): stderr: | 20221208230826334 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230826334 DLGLOBAL DEBUG validating counter group 0x7f11f4a46c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230826334 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230826334 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230826334 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230826334 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230826336 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230826336 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230826337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230826337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:08:27.305397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25997): Terminating (SIGTERM) 23:08:27.346139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26000): Terminating (SIGTERM) 23:08:27.386874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26003): Terminating (SIGTERM) 23:08:27.427886 --- ParallelTerminationStrategy: PID 25997 died... 23:08:27.447342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25997): Terminated: ok {rc=0} 23:08:27.492883 --- ParallelTerminationStrategy: PID 26000 died... 23:08:27.512384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26000): Terminated: ok {rc=0} 23:08:27.557705 --- ParallelTerminationStrategy: PID 26003 died... 23:08:27.577248 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26003): Terminated: ok {rc=0} 23:08:27.664462 bus /sierra_3: Setting Powered False 23:08:28.763862 bus /sierra_3: Setting Powered False 23:08:29.880740 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 23:08:31.178070 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:08:31.184109 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:08:31.237495 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:08:31.265349 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:08:31.317814 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:08:31.369472 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:08:31.398102 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:08:32.001503 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 23:08:32.010101 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:32.025873 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:08:32.072537 tst handover.py: using LAC 17411 23:08:32.217013 tst handover.py: using RAC 71 23:08:32.357521 tst handover.py: using CellId 17411 23:08:32.482582 tst handover.py: using BVCI 17412 23:08:32.595743 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:08:32.642630 tst handover.py: using LAC 17412 23:08:32.765310 tst handover.py: using RAC 72 23:08:32.888278 tst handover.py: using CellId 17412 23:08:33.011815 tst handover.py: using BVCI 17413 23:08:33.125740 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:33.136510 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:33.147108 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:33.157960 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:33.168780 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:33.179710 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:08:33.298137 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:08:33.416287 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:08:33.897114 run create_hlr_db(pid=26009): Launched 23:08:34.030633 bus /sierra_2: Setting Powered False 23:08:35.095643 run create_hlr_db(pid=26009): Terminated: ok {rc=0} 23:08:35.525105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26011): Launched 23:08:35.853039 run osmo-hlr_10.42.42.2(pid=26012): Launched 23:08:35.977934 run osmo-stp_10.42.42.5: Starting osmo-stp 23:08:36.519324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26014): Launched 23:08:36.846898 run osmo-stp_10.42.42.5(pid=26015): Launched 23:08:36.971591 run osmo-msc_10.42.42.6: Starting osmo-msc 23:08:37.536555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26017): Launched 23:08:37.865548 run osmo-msc_10.42.42.6(pid=26018): Launched 23:08:38.049231 run osmo-stp_10.42.42.5(pid=26015): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26015)] 23:08:38.191713 run osmo-stp_10.42.42.5(pid=26015): stdout: | (launched: 2022-12-08_23:08:36.787561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:38.331612 run osmo-stp_10.42.42.5(pid=26015): stderr: | 20221208230836980 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230836980 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230836980 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230836981 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230836981 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230836981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230836981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:38.470357 run osmo-stp_10.42.42.5(pid=26015): stdout: | (launched: 2022-12-08_23:08:36.787561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:38.601988 run osmo-stp_10.42.42.5(pid=26015): stderr: | 20221208230836980 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230836980 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230836980 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230836981 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230836981 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230836981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230836981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:38.759483 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26015): Process ended prematurely: osmo-stp_10.42.42.5(pid=26015) [trial-2350↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26015)] [trial-2350↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 23:08:38.768560 tst handover.py:18: Test FAILED (6.8 sec) 23:08:38.796662 run osmo-hlr_10.42.42.2(pid=26012): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26012)] 23:08:38.847951 run osmo-hlr_10.42.42.2(pid=26012): stdout: | (launched: 2022-12-08_23:08:35.793547) 23:08:38.901140 run osmo-hlr_10.42.42.2(pid=26012): stderr: | 20221208230835993 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230835993 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230835993 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230835993 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230835993 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230835993 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230836006 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230836014 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230836014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230836014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:08:38.975057 run osmo-msc_10.42.42.6(pid=26018): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26018)] 23:08:39.026858 run osmo-msc_10.42.42.6(pid=26018): stdout: | (launched: 2022-12-08_23:08:37.805825) 23:08:39.079849 run osmo-msc_10.42.42.6(pid=26018): stderr: | 20221208230838126 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230838127 DLGLOBAL DEBUG validating counter group 0x7f438a721c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230838127 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230838127 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230838127 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230838127 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230838129 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230838129 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230838129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230838129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:08:39.133307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26011): Terminating (SIGTERM) 23:08:39.176229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26014): Terminating (SIGTERM) 23:08:39.218961 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26017): Terminating (SIGTERM) 23:08:39.262394 --- ParallelTerminationStrategy: PID 26011 died... 23:08:39.282335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26011): Terminated: ok {rc=0} 23:08:39.329940 --- ParallelTerminationStrategy: PID 26014 died... 23:08:39.350011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26014): Terminated: ok {rc=0} 23:08:39.397222 --- ParallelTerminationStrategy: PID 26017 died... 23:08:39.417225 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26017): Terminated: ok {rc=0} 23:08:39.506154 bus /sierra_3: Setting Powered False 23:08:40.606190 bus /sierra_3: Setting Powered False 23:08:41.724335 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2350 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 23:08:42.978290 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:08:42.983454 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:08:43.044846 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:08:43.071058 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:08:43.123409 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:08:43.185623 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:08:43.212317 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:08:43.765216 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2350 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 23:08:43.770644 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:43.782044 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:08:43.830923 tst handover.py: using LAC 17413 23:08:43.960590 tst handover.py: using RAC 73 23:08:44.088673 tst handover.py: using CellId 17413 23:08:44.216732 tst handover.py: using BVCI 17414 23:08:44.337223 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:08:44.385647 tst handover.py: using LAC 17414 23:08:44.514813 tst handover.py: using RAC 74 23:08:44.643513 tst handover.py: using CellId 17414 23:08:44.773441 tst handover.py: using BVCI 17415 23:08:44.892111 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:44.903414 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:44.914635 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:44.925856 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:44.936909 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:44.948245 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:08:45.063312 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:08:45.180844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:08:45.631711 run create_hlr_db(pid=26023): Launched 23:08:45.750109 bus /sierra_2: Setting Powered False 23:08:46.818964 run create_hlr_db(pid=26023): Terminated: ok {rc=0} 23:08:47.283391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26025): Launched 23:08:47.591362 run osmo-hlr_10.42.42.2(pid=26026): Launched 23:08:47.708084 run osmo-stp_10.42.42.5: Starting osmo-stp 23:08:48.229490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26028): Launched 23:08:48.537089 run osmo-stp_10.42.42.5(pid=26029): Launched 23:08:48.655344 run osmo-msc_10.42.42.6: Starting osmo-msc 23:08:49.183747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26032): Launched 23:08:49.491666 run osmo-msc_10.42.42.6(pid=26033): Launched 23:08:49.662720 run osmo-stp_10.42.42.5(pid=26029): ERR: Terminated: ERROR {rc=1} [trial-2350↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26029)] 23:08:49.794036 run osmo-stp_10.42.42.5(pid=26029): stdout: | (launched: 2022-12-08_23:08:48.480869) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:49.925807 run osmo-stp_10.42.42.5(pid=26029): stderr: | 20221208230848657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230848657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230848657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230848658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230848658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230848658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230848658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:50.054442 run osmo-stp_10.42.42.5(pid=26029): stdout: | (launched: 2022-12-08_23:08:48.480869) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:50.176905 run osmo-stp_10.42.42.5(pid=26029): stderr: | 20221208230848657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221208230848657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221208230848657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221208230848658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208230848658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208230848658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208230848658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:50.324175 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26029): Process ended prematurely: osmo-stp_10.42.42.5(pid=26029) [trial-2350↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26029)] [trial-2350↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 23:08:50.332379 tst handover.py:18: Test FAILED (6.6 sec) 23:08:50.359332 run osmo-hlr_10.42.42.2(pid=26026): ERR: Terminated: ERROR {rc=237} [trial-2350↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26026)] 23:08:50.408654 run osmo-hlr_10.42.42.2(pid=26026): stdout: | (launched: 2022-12-08_23:08:47.535131) 23:08:50.459671 run osmo-hlr_10.42.42.2(pid=26026): stderr: | 20221208230847712 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221208230847712 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221208230847713 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221208230847713 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221208230847713 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221208230847713 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221208230847724 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221208230847734 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208230847734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208230847734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:08:50.530665 run osmo-msc_10.42.42.6(pid=26033): ERR: Terminated: ERROR {rc=2} [trial-2350↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26033)] 23:08:50.579585 run osmo-msc_10.42.42.6(pid=26033): stdout: | (launched: 2022-12-08_23:08:49.435229) 23:08:50.630858 run osmo-msc_10.42.42.6(pid=26033): stderr: | 20221208230849710 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221208230849710 DLGLOBAL DEBUG validating counter group 0x7fa75081ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221208230849710 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221208230849710 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221208230849710 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221208230849710 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221208230849712 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221208230849712 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208230849712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208230849713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:08:50.682072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26025): Terminating (SIGTERM) 23:08:50.723036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26028): Terminating (SIGTERM) 23:08:50.763848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26032): Terminating (SIGTERM) 23:08:50.804843 --- ParallelTerminationStrategy: PID 26025 died... 23:08:50.824332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26025): Terminated: ok {rc=0} 23:08:50.870060 --- ParallelTerminationStrategy: PID 26028 died... 23:08:50.888911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26028): Terminated: ok {rc=0} 23:08:50.934237 --- ParallelTerminationStrategy: PID 26032 died... 23:08:50.953162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26032): Terminated: ok {rc=0} 23:08:51.038659 bus /sierra_3: Setting Powered False 23:08:52.138673 bus /sierra_3: Setting Powered False 23:08:53.259419 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2350 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 23:08:54.525988 tst trial-2350: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350/run.2022-12-08_21-44-24/trial-2350.xml -------------------------------------------------------------------------------------------- trial-2350 FAIL -------------------------------------------------------------------------------------------- 23:08:56.463771 tst trial-2350: trial-2350: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (4.8 sec) Error: osmo-nitb_10.42.42.2(pid=17587): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17587) [trial-2350↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17587)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (13.9 sec) Error: osmo-stp_10.42.42.5(pid=17599): Process ended prematurely: osmo-stp_10.42.42.5(pid=17599) [trial-2350↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17599)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=17608): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17608) [trial-2350↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17608)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=17619): Process ended prematurely: osmo-stp_10.42.42.5(pid=17619) [trial-2350↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17619)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17634): Process ended prematurely: osmo-stp_10.42.42.5(pid=17634) [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17634)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17645): Process ended prematurely: osmo-stp_10.42.42.5(pid=17645) [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17645)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=17660): Process ended prematurely: osmo-stp_10.42.42.5(pid=17660) [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17660)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17671): Process ended prematurely: osmo-stp_10.42.42.5(pid=17671) [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17671)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17685): Process ended prematurely: osmo-stp_10.42.42.5(pid=17685) [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17685)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17696): Process ended prematurely: osmo-stp_10.42.42.5(pid=17696) [trial-2350↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17696)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=17710): Process ended prematurely: osmo-stp_10.42.42.5(pid=17710) [trial-2350↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17710)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17721): Process ended prematurely: osmo-stp_10.42.42.5(pid=17721) [trial-2350↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17721)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=17735): Process ended prematurely: osmo-stp_10.42.42.5(pid=17735) [trial-2350↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17735)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=17756): Process ended prematurely: osmo-stp_10.42.42.5(pid=17756) [trial-2350↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17756)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17771): Process ended prematurely: osmo-stp_10.42.42.5(pid=17771) [trial-2350↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17771)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17782): Process ended prematurely: osmo-stp_10.42.42.5(pid=17782) [trial-2350↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17782)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17796): Process ended prematurely: osmo-stp_10.42.42.5(pid=17796) [trial-2350↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17796)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=17807): Process ended prematurely: osmo-stp_10.42.42.5(pid=17807) [trial-2350↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17807)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17821): Process ended prematurely: osmo-stp_10.42.42.5(pid=17821) [trial-2350↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17821)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17832): Process ended prematurely: osmo-stp_10.42.42.5(pid=17832) [trial-2350↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17832)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (10.1 sec) Error: osmo-stp_10.42.42.5(pid=17853): Process ended prematurely: osmo-stp_10.42.42.5(pid=17853) [trial-2350↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17853)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=17865): Process ended prematurely: osmo-stp_10.42.42.5(pid=17865) [trial-2350↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17865)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=17883): Process ended prematurely: osmo-stp_10.42.42.5(pid=17883) [trial-2350↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17883)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17893): Process ended prematurely: osmo-stp_10.42.42.5(pid=17893) [trial-2350↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17893)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17903): Process ended prematurely: osmo-stp_10.42.42.5(pid=17903) [trial-2350↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17903)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=17920): Process ended prematurely: osmo-stp_10.42.42.5(pid=17920) [trial-2350↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17920)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=17932): Process ended prematurely: osmo-stp_10.42.42.5(pid=17932) [trial-2350↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17932)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=17950): Process ended prematurely: osmo-stp_10.42.42.5(pid=17950) [trial-2350↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17950)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17960): Process ended prematurely: osmo-stp_10.42.42.5(pid=17960) [trial-2350↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17960)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17970): Process ended prematurely: osmo-stp_10.42.42.5(pid=17970) [trial-2350↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17970)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=17988): Process ended prematurely: osmo-stp_10.42.42.5(pid=17988) [trial-2350↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17988)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=18000): Process ended prematurely: osmo-stp_10.42.42.5(pid=18000) [trial-2350↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18000)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=18024): Process ended prematurely: osmo-stp_10.42.42.5(pid=18024) [trial-2350↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18024)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18034): Process ended prematurely: osmo-stp_10.42.42.5(pid=18034) [trial-2350↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18034)] FAIL: ping_idle_ping.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=18316): Process ended prematurely: osmo-stp_10.42.42.5(pid=18316) [trial-2350↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18316)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (10.0 sec) Error: osmo-stp_10.42.42.5(pid=18333): Process ended prematurely: osmo-stp_10.42.42.5(pid=18333) [trial-2350↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18333)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=18345): Process ended prematurely: osmo-stp_10.42.42.5(pid=18345) [trial-2350↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18345)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=18365): Process ended prematurely: osmo-stp_10.42.42.5(pid=18365) [trial-2350↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18365)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=18376): Process ended prematurely: osmo-stp_10.42.42.5(pid=18376) [trial-2350↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18376)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18387): Process ended prematurely: osmo-stp_10.42.42.5(pid=18387) [trial-2350↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18387)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=18400): Process ended prematurely: osmo-stp_10.42.42.5(pid=18400) [trial-2350↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18400)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18413): Process ended prematurely: osmo-stp_10.42.42.5(pid=18413) [trial-2350↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18413)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=18421): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18421) [trial-2350↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18421)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18432): Process ended prematurely: osmo-stp_10.42.42.5(pid=18432) [trial-2350↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18432)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=18441): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18441) [trial-2350↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18441)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18454): Process ended prematurely: osmo-stp_10.42.42.5(pid=18454) [trial-2350↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18454)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18468): Process ended prematurely: osmo-stp_10.42.42.5(pid=18468) [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18468)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18479): Process ended prematurely: osmo-stp_10.42.42.5(pid=18479) [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18479)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18493): Process ended prematurely: osmo-stp_10.42.42.5(pid=18493) [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18493)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18504): Process ended prematurely: osmo-stp_10.42.42.5(pid=18504) [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18504)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=18518): Process ended prematurely: osmo-stp_10.42.42.5(pid=18518) [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18518)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18529): Process ended prematurely: osmo-stp_10.42.42.5(pid=18529) [trial-2350↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18529)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18543): Process ended prematurely: osmo-stp_10.42.42.5(pid=18543) [trial-2350↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18543)] FAIL: mo_mt_call_osmux.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=18554): Process ended prematurely: osmo-stp_10.42.42.5(pid=18554) [trial-2350↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18554)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18568): Process ended prematurely: osmo-stp_10.42.42.5(pid=18568) [trial-2350↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18568)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18579): Process ended prematurely: osmo-stp_10.42.42.5(pid=18579) [trial-2350↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18579)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18593): Process ended prematurely: osmo-stp_10.42.42.5(pid=18593) [trial-2350↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18593)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18604): Process ended prematurely: osmo-stp_10.42.42.5(pid=18604) [trial-2350↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18604)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18620): Process ended prematurely: osmo-stp_10.42.42.5(pid=18620) [trial-2350↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18620)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18631): Process ended prematurely: osmo-stp_10.42.42.5(pid=18631) [trial-2350↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18631)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18650): Process ended prematurely: osmo-stp_10.42.42.5(pid=18650) [trial-2350↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18650)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18661): Process ended prematurely: osmo-stp_10.42.42.5(pid=18661) [trial-2350↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18661)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=18679): Process ended prematurely: osmo-stp_10.42.42.5(pid=18679) [trial-2350↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18679)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=18691): Process ended prematurely: osmo-stp_10.42.42.5(pid=18691) [trial-2350↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18691)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=18709): Process ended prematurely: osmo-stp_10.42.42.5(pid=18709) [trial-2350↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18709)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18719): Process ended prematurely: osmo-stp_10.42.42.5(pid=18719) [trial-2350↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18719)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18729): Process ended prematurely: osmo-stp_10.42.42.5(pid=18729) [trial-2350↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18729)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=18747): Process ended prematurely: osmo-stp_10.42.42.5(pid=18747) [trial-2350↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18747)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=18760): Process ended prematurely: osmo-stp_10.42.42.5(pid=18760) [trial-2350↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18760)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=18778): Process ended prematurely: osmo-stp_10.42.42.5(pid=18778) [trial-2350↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18778)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18788): Process ended prematurely: osmo-stp_10.42.42.5(pid=18788) [trial-2350↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18788)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18801): Process ended prematurely: osmo-stp_10.42.42.5(pid=18801) [trial-2350↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18801)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=18818): Process ended prematurely: osmo-stp_10.42.42.5(pid=18818) [trial-2350↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18818)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=18830): Process ended prematurely: osmo-stp_10.42.42.5(pid=18830) [trial-2350↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18830)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=18848): Process ended prematurely: osmo-stp_10.42.42.5(pid=18848) [trial-2350↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18848)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18858): Process ended prematurely: osmo-stp_10.42.42.5(pid=18858) [trial-2350↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18858)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18868): Process ended prematurely: osmo-stp_10.42.42.5(pid=18868) [trial-2350↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18868)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=18887): Process ended prematurely: osmo-stp_10.42.42.5(pid=18887) [trial-2350↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18887)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=18899): Process ended prematurely: osmo-stp_10.42.42.5(pid=18899) [trial-2350↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18899)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=18917): Process ended prematurely: osmo-stp_10.42.42.5(pid=18917) [trial-2350↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18917)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18927): Process ended prematurely: osmo-stp_10.42.42.5(pid=18927) [trial-2350↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18927)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18937): Process ended prematurely: osmo-stp_10.42.42.5(pid=18937) [trial-2350↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18937)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18950): Process ended prematurely: osmo-stp_10.42.42.5(pid=18950) [trial-2350↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18950)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18964): Process ended prematurely: osmo-stp_10.42.42.5(pid=18964) [trial-2350↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18964)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=18973): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18973) [trial-2350↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18973)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=18984): Process ended prematurely: osmo-stp_10.42.42.5(pid=18984) [trial-2350↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18984)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=18993): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18993) [trial-2350↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18993)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=19003): Process ended prematurely: osmo-stp_10.42.42.5(pid=19003) [trial-2350↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19003)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19018): Process ended prematurely: osmo-stp_10.42.42.5(pid=19018) [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19018)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19029): Process ended prematurely: osmo-stp_10.42.42.5(pid=19029) [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19029)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=19043): Process ended prematurely: osmo-stp_10.42.42.5(pid=19043) [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19043)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19054): Process ended prematurely: osmo-stp_10.42.42.5(pid=19054) [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19054)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19068): Process ended prematurely: osmo-stp_10.42.42.5(pid=19068) [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19068)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19079): Process ended prematurely: osmo-stp_10.42.42.5(pid=19079) [trial-2350↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19079)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=19093): Process ended prematurely: osmo-stp_10.42.42.5(pid=19093) [trial-2350↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19093)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19104): Process ended prematurely: osmo-stp_10.42.42.5(pid=19104) [trial-2350↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19104)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19119): Process ended prematurely: osmo-stp_10.42.42.5(pid=19119) [trial-2350↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19119)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19130): Process ended prematurely: osmo-stp_10.42.42.5(pid=19130) [trial-2350↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19130)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=19146): Process ended prematurely: osmo-stp_10.42.42.5(pid=19146) [trial-2350↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19146)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19160): Process ended prematurely: osmo-stp_10.42.42.5(pid=19160) [trial-2350↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19160)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=19174): Process ended prematurely: osmo-stp_10.42.42.5(pid=19174) [trial-2350↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19174)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19185): Process ended prematurely: osmo-stp_10.42.42.5(pid=19185) [trial-2350↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19185)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=19200): Process ended prematurely: osmo-stp_10.42.42.5(pid=19200) [trial-2350↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19200)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19211): Process ended prematurely: osmo-stp_10.42.42.5(pid=19211) [trial-2350↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19211)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19225): Process ended prematurely: osmo-stp_10.42.42.5(pid=19225) [trial-2350↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19225)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19236): Process ended prematurely: osmo-stp_10.42.42.5(pid=19236) [trial-2350↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19236)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19250): Process ended prematurely: osmo-stp_10.42.42.5(pid=19250) [trial-2350↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19250)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19261): Process ended prematurely: osmo-stp_10.42.42.5(pid=19261) [trial-2350↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19261)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=19279): Process ended prematurely: osmo-stp_10.42.42.5(pid=19279) [trial-2350↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19279)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=19291): Process ended prematurely: osmo-stp_10.42.42.5(pid=19291) [trial-2350↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19291)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=19309): Process ended prematurely: osmo-stp_10.42.42.5(pid=19309) [trial-2350↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19309)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19319): Process ended prematurely: osmo-stp_10.42.42.5(pid=19319) [trial-2350↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19319)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19331): Process ended prematurely: osmo-stp_10.42.42.5(pid=19331) [trial-2350↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19331)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=19348): Process ended prematurely: osmo-stp_10.42.42.5(pid=19348) [trial-2350↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19348)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=19360): Process ended prematurely: osmo-stp_10.42.42.5(pid=19360) [trial-2350↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19360)] FAIL: iperf3m4.py (12.0 sec) Error: osmo-stp_10.42.42.5(pid=19651): Process ended prematurely: osmo-stp_10.42.42.5(pid=19651) [trial-2350↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19651)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19661): Process ended prematurely: osmo-stp_10.42.42.5(pid=19661) [trial-2350↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19661)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19671): Process ended prematurely: osmo-stp_10.42.42.5(pid=19671) [trial-2350↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19671)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=19690): Process ended prematurely: osmo-stp_10.42.42.5(pid=19690) [trial-2350↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19690)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=19702): Process ended prematurely: osmo-stp_10.42.42.5(pid=19702) [trial-2350↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19702)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=19720): Process ended prematurely: osmo-stp_10.42.42.5(pid=19720) [trial-2350↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19720)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19730): Process ended prematurely: osmo-stp_10.42.42.5(pid=19730) [trial-2350↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19730)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19746): Process ended prematurely: osmo-stp_10.42.42.5(pid=19746) [trial-2350↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19746)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=19764): Process ended prematurely: osmo-stp_10.42.42.5(pid=19764) [trial-2350↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19764)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=19780): Process ended prematurely: osmo-stp_10.42.42.5(pid=19780) [trial-2350↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19780)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=19801): Process ended prematurely: osmo-stp_10.42.42.5(pid=19801) [trial-2350↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19801)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19811): Process ended prematurely: osmo-stp_10.42.42.5(pid=19811) [trial-2350↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19811)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19821): Process ended prematurely: osmo-stp_10.42.42.5(pid=19821) [trial-2350↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19821)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=19838): Process ended prematurely: osmo-stp_10.42.42.5(pid=19838) [trial-2350↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19838)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=19850): Process ended prematurely: osmo-stp_10.42.42.5(pid=19850) [trial-2350↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19850)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=19868): Process ended prematurely: osmo-stp_10.42.42.5(pid=19868) [trial-2350↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19868)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19878): Process ended prematurely: osmo-stp_10.42.42.5(pid=19878) [trial-2350↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19878)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19889): Process ended prematurely: osmo-stp_10.42.42.5(pid=19889) [trial-2350↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19889)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19903): Process ended prematurely: osmo-stp_10.42.42.5(pid=19903) [trial-2350↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19903)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19916): Process ended prematurely: osmo-stp_10.42.42.5(pid=19916) [trial-2350↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19916)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=19924): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19924) [trial-2350↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19924)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19934): Process ended prematurely: osmo-stp_10.42.42.5(pid=19934) [trial-2350↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19934)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=19943): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19943) [trial-2350↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19943)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19953): Process ended prematurely: osmo-stp_10.42.42.5(pid=19953) [trial-2350↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19953)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19968): Process ended prematurely: osmo-stp_10.42.42.5(pid=19968) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19968)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=19979): Process ended prematurely: osmo-stp_10.42.42.5(pid=19979) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19979)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19993): Process ended prematurely: osmo-stp_10.42.42.5(pid=19993) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19993)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20004): Process ended prematurely: osmo-stp_10.42.42.5(pid=20004) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20004)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20018): Process ended prematurely: osmo-stp_10.42.42.5(pid=20018) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20018)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20030): Process ended prematurely: osmo-stp_10.42.42.5(pid=20030) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20030)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20044): Process ended prematurely: osmo-stp_10.42.42.5(pid=20044) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20044)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20055): Process ended prematurely: osmo-stp_10.42.42.5(pid=20055) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20055)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20069): Process ended prematurely: osmo-stp_10.42.42.5(pid=20069) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20069)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20080): Process ended prematurely: osmo-stp_10.42.42.5(pid=20080) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20080)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20094): Process ended prematurely: osmo-stp_10.42.42.5(pid=20094) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20094)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20105): Process ended prematurely: osmo-stp_10.42.42.5(pid=20105) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20105)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20119): Process ended prematurely: osmo-stp_10.42.42.5(pid=20119) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20119)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20134): Process ended prematurely: osmo-stp_10.42.42.5(pid=20134) [trial-2350↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20134)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20149): Process ended prematurely: osmo-stp_10.42.42.5(pid=20149) [trial-2350↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20149)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20160): Process ended prematurely: osmo-stp_10.42.42.5(pid=20160) [trial-2350↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20160)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=20178): Process ended prematurely: osmo-stp_10.42.42.5(pid=20178) [trial-2350↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20178)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=20190): Process ended prematurely: osmo-stp_10.42.42.5(pid=20190) [trial-2350↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20190)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=20208): Process ended prematurely: osmo-stp_10.42.42.5(pid=20208) [trial-2350↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20208)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20218): Process ended prematurely: osmo-stp_10.42.42.5(pid=20218) [trial-2350↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20218)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20228): Process ended prematurely: osmo-stp_10.42.42.5(pid=20228) [trial-2350↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20228)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=20245): Process ended prematurely: osmo-stp_10.42.42.5(pid=20245) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20245)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=20257): Process ended prematurely: osmo-stp_10.42.42.5(pid=20257) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20257)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=20278): Process ended prematurely: osmo-stp_10.42.42.5(pid=20278) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20278)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20288): Process ended prematurely: osmo-stp_10.42.42.5(pid=20288) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20288)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20298): Process ended prematurely: osmo-stp_10.42.42.5(pid=20298) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20298)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=20318): Process ended prematurely: osmo-stp_10.42.42.5(pid=20318) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20318)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=20330): Process ended prematurely: osmo-stp_10.42.42.5(pid=20330) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20330)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=20348): Process ended prematurely: osmo-stp_10.42.42.5(pid=20348) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20348)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20358): Process ended prematurely: osmo-stp_10.42.42.5(pid=20358) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20358)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20368): Process ended prematurely: osmo-stp_10.42.42.5(pid=20368) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20368)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=20385): Process ended prematurely: osmo-stp_10.42.42.5(pid=20385) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20385)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=20397): Process ended prematurely: osmo-stp_10.42.42.5(pid=20397) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20397)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=20416): Process ended prematurely: osmo-stp_10.42.42.5(pid=20416) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20416)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20426): Process ended prematurely: osmo-stp_10.42.42.5(pid=20426) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20426)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20436): Process ended prematurely: osmo-stp_10.42.42.5(pid=20436) [trial-2350↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20436)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20450): Process ended prematurely: osmo-stp_10.42.42.5(pid=20450) [trial-2350↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20450)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20463): Process ended prematurely: osmo-stp_10.42.42.5(pid=20463) [trial-2350↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20463)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=20472): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20472) [trial-2350↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20472)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=20493): Process ended prematurely: osmo-stp_10.42.42.5(pid=20493) [trial-2350↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20493)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=20853): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20853) [trial-2350↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20853)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=21038): Process ended prematurely: osmo-stp_10.42.42.5(pid=21038) [trial-2350↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21038)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21053): Process ended prematurely: osmo-stp_10.42.42.5(pid=21053) [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21053)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21064): Process ended prematurely: osmo-stp_10.42.42.5(pid=21064) [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21064)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21078): Process ended prematurely: osmo-stp_10.42.42.5(pid=21078) [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21078)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21089): Process ended prematurely: osmo-stp_10.42.42.5(pid=21089) [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21089)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21103): Process ended prematurely: osmo-stp_10.42.42.5(pid=21103) [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21103)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21114): Process ended prematurely: osmo-stp_10.42.42.5(pid=21114) [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21114)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21128): Process ended prematurely: osmo-stp_10.42.42.5(pid=21128) [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21128)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21139): Process ended prematurely: osmo-stp_10.42.42.5(pid=21139) [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21139)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21153): Process ended prematurely: osmo-stp_10.42.42.5(pid=21153) [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21153)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21165): Process ended prematurely: osmo-stp_10.42.42.5(pid=21165) [trial-2350↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21165)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21180): Process ended prematurely: osmo-stp_10.42.42.5(pid=21180) [trial-2350↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21180)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21191): Process ended prematurely: osmo-stp_10.42.42.5(pid=21191) [trial-2350↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21191)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21207): Process ended prematurely: osmo-stp_10.42.42.5(pid=21207) [trial-2350↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21207)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21218): Process ended prematurely: osmo-stp_10.42.42.5(pid=21218) [trial-2350↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21218)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=21503): Process ended prematurely: osmo-stp_10.42.42.5(pid=21503) [trial-2350↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21503)] FAIL: mo_mt_call_osmux.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=21515): Process ended prematurely: osmo-stp_10.42.42.5(pid=21515) [trial-2350↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21515)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21530): Process ended prematurely: osmo-stp_10.42.42.5(pid=21530) [trial-2350↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21530)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21541): Process ended prematurely: osmo-stp_10.42.42.5(pid=21541) [trial-2350↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21541)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=21560): Process ended prematurely: osmo-stp_10.42.42.5(pid=21560) [trial-2350↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21560)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=21572): Process ended prematurely: osmo-stp_10.42.42.5(pid=21572) [trial-2350↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21572)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=21592): Process ended prematurely: osmo-stp_10.42.42.5(pid=21592) [trial-2350↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21592)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21602): Process ended prematurely: osmo-stp_10.42.42.5(pid=21602) [trial-2350↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21602)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=21612): Process ended prematurely: osmo-stp_10.42.42.5(pid=21612) [trial-2350↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21612)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=21629): Process ended prematurely: osmo-stp_10.42.42.5(pid=21629) [trial-2350↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21629)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=21644): Process ended prematurely: osmo-stp_10.42.42.5(pid=21644) [trial-2350↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21644)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=21663): Process ended prematurely: osmo-stp_10.42.42.5(pid=21663) [trial-2350↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21663)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21674): Process ended prematurely: osmo-stp_10.42.42.5(pid=21674) [trial-2350↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21674)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=21684): Process ended prematurely: osmo-stp_10.42.42.5(pid=21684) [trial-2350↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21684)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=21701): Process ended prematurely: osmo-stp_10.42.42.5(pid=21701) [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21701)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=21713): Process ended prematurely: osmo-stp_10.42.42.5(pid=21713) [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21713)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=21731): Process ended prematurely: osmo-stp_10.42.42.5(pid=21731) [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21731)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21741): Process ended prematurely: osmo-stp_10.42.42.5(pid=21741) [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21741)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21751): Process ended prematurely: osmo-stp_10.42.42.5(pid=21751) [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21751)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=21769): Process ended prematurely: osmo-stp_10.42.42.5(pid=21769) [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21769)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=21781): Process ended prematurely: osmo-stp_10.42.42.5(pid=21781) [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21781)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=21799): Process ended prematurely: osmo-stp_10.42.42.5(pid=21799) [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21799)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21809): Process ended prematurely: osmo-stp_10.42.42.5(pid=21809) [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21809)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21819): Process ended prematurely: osmo-stp_10.42.42.5(pid=21819) [trial-2350↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21819)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=21837): Process ended prematurely: osmo-stp_10.42.42.5(pid=21837) [trial-2350↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21837)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=21849): Process ended prematurely: osmo-stp_10.42.42.5(pid=21849) [trial-2350↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21849)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=21867): Process ended prematurely: osmo-stp_10.42.42.5(pid=21867) [trial-2350↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21867)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21878): Process ended prematurely: osmo-stp_10.42.42.5(pid=21878) [trial-2350↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21878)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21888): Process ended prematurely: osmo-stp_10.42.42.5(pid=21888) [trial-2350↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21888)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21901): Process ended prematurely: osmo-stp_10.42.42.5(pid=21901) [trial-2350↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21901)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21914): Process ended prematurely: osmo-stp_10.42.42.5(pid=21914) [trial-2350↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21914)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=21922): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21922) [trial-2350↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21922)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=21932): Process ended prematurely: osmo-stp_10.42.42.5(pid=21932) [trial-2350↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21932)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=21941): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21941) [trial-2350↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21941)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=21951): Process ended prematurely: osmo-stp_10.42.42.5(pid=21951) [trial-2350↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21951)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21965): Process ended prematurely: osmo-stp_10.42.42.5(pid=21965) [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21965)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21976): Process ended prematurely: osmo-stp_10.42.42.5(pid=21976) [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21976)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21996): Process ended prematurely: osmo-stp_10.42.42.5(pid=21996) [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21996)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22007): Process ended prematurely: osmo-stp_10.42.42.5(pid=22007) [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22007)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22022): Process ended prematurely: osmo-stp_10.42.42.5(pid=22022) [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22022)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22033): Process ended prematurely: osmo-stp_10.42.42.5(pid=22033) [trial-2350↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22033)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22047): Process ended prematurely: osmo-stp_10.42.42.5(pid=22047) [trial-2350↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22047)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22058): Process ended prematurely: osmo-stp_10.42.42.5(pid=22058) [trial-2350↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22058)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22072): Process ended prematurely: osmo-stp_10.42.42.5(pid=22072) [trial-2350↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22072)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22083): Process ended prematurely: osmo-stp_10.42.42.5(pid=22083) [trial-2350↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22083)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22098): Process ended prematurely: osmo-stp_10.42.42.5(pid=22098) [trial-2350↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22098)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22109): Process ended prematurely: osmo-stp_10.42.42.5(pid=22109) [trial-2350↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22109)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22123): Process ended prematurely: osmo-stp_10.42.42.5(pid=22123) [trial-2350↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22123)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22134): Process ended prematurely: osmo-stp_10.42.42.5(pid=22134) [trial-2350↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22134)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22149): Process ended prematurely: osmo-stp_10.42.42.5(pid=22149) [trial-2350↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22149)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22160): Process ended prematurely: osmo-stp_10.42.42.5(pid=22160) [trial-2350↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22160)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=22178): Process ended prematurely: osmo-stp_10.42.42.5(pid=22178) [trial-2350↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22178)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=22190): Process ended prematurely: osmo-stp_10.42.42.5(pid=22190) [trial-2350↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22190)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=22209): Process ended prematurely: osmo-stp_10.42.42.5(pid=22209) [trial-2350↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22209)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22219): Process ended prematurely: osmo-stp_10.42.42.5(pid=22219) [trial-2350↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22219)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22229): Process ended prematurely: osmo-stp_10.42.42.5(pid=22229) [trial-2350↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22229)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=22246): Process ended prematurely: osmo-stp_10.42.42.5(pid=22246) [trial-2350↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22246)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=22259): Process ended prematurely: osmo-stp_10.42.42.5(pid=22259) [trial-2350↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22259)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=22277): Process ended prematurely: osmo-stp_10.42.42.5(pid=22277) [trial-2350↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22277)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22287): Process ended prematurely: osmo-stp_10.42.42.5(pid=22287) [trial-2350↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22287)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22297): Process ended prematurely: osmo-stp_10.42.42.5(pid=22297) [trial-2350↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22297)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=22314): Process ended prematurely: osmo-stp_10.42.42.5(pid=22314) [trial-2350↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22314)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=22327): Process ended prematurely: osmo-stp_10.42.42.5(pid=22327) [trial-2350↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22327)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=22348): Process ended prematurely: osmo-stp_10.42.42.5(pid=22348) [trial-2350↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22348)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22358): Process ended prematurely: osmo-stp_10.42.42.5(pid=22358) [trial-2350↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22358)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22368): Process ended prematurely: osmo-stp_10.42.42.5(pid=22368) [trial-2350↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22368)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=22386): Process ended prematurely: osmo-stp_10.42.42.5(pid=22386) [trial-2350↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22386)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=22399): Process ended prematurely: osmo-stp_10.42.42.5(pid=22399) [trial-2350↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22399)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=22417): Process ended prematurely: osmo-stp_10.42.42.5(pid=22417) [trial-2350↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22417)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22427): Process ended prematurely: osmo-stp_10.42.42.5(pid=22427) [trial-2350↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22427)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22437): Process ended prematurely: osmo-stp_10.42.42.5(pid=22437) [trial-2350↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22437)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=22451): Process ended prematurely: osmo-stp_10.42.42.5(pid=22451) [trial-2350↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22451)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22464): Process ended prematurely: osmo-stp_10.42.42.5(pid=22464) [trial-2350↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22464)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=22472): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22472) [trial-2350↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22472)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22482): Process ended prematurely: osmo-stp_10.42.42.5(pid=22482) [trial-2350↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22482)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=22491): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22491) [trial-2350↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22491)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22501): Process ended prematurely: osmo-stp_10.42.42.5(pid=22501) [trial-2350↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22501)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22517): Process ended prematurely: osmo-stp_10.42.42.5(pid=22517) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22517)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22528): Process ended prematurely: osmo-stp_10.42.42.5(pid=22528) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22528)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=22811): Process ended prematurely: osmo-stp_10.42.42.5(pid=22811) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22811)] FAIL: mo_mt_call_osmux.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=22824): Process ended prematurely: osmo-stp_10.42.42.5(pid=22824) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22824)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22839): Process ended prematurely: osmo-stp_10.42.42.5(pid=22839) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22839)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22850): Process ended prematurely: osmo-stp_10.42.42.5(pid=22850) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22850)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22865): Process ended prematurely: osmo-stp_10.42.42.5(pid=22865) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22865)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22876): Process ended prematurely: osmo-stp_10.42.42.5(pid=22876) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22876)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22890): Process ended prematurely: osmo-stp_10.42.42.5(pid=22890) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22890)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22901): Process ended prematurely: osmo-stp_10.42.42.5(pid=22901) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22901)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22916): Process ended prematurely: osmo-stp_10.42.42.5(pid=22916) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22916)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22927): Process ended prematurely: osmo-stp_10.42.42.5(pid=22927) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22927)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22942): Process ended prematurely: osmo-stp_10.42.42.5(pid=22942) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22942)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22963): Process ended prematurely: osmo-stp_10.42.42.5(pid=22963) [trial-2350↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22963)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23328): Process ended prematurely: osmo-stp_10.42.42.5(pid=23328) [trial-2350↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23328)] FAIL: emergency_preemptive_call.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=23514): Process ended prematurely: osmo-stp_10.42.42.5(pid=23514) [trial-2350↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23514)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=23533): Process ended prematurely: osmo-stp_10.42.42.5(pid=23533) [trial-2350↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23533)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=23545): Process ended prematurely: osmo-stp_10.42.42.5(pid=23545) [trial-2350↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23545)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=23564): Process ended prematurely: osmo-stp_10.42.42.5(pid=23564) [trial-2350↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23564)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23575): Process ended prematurely: osmo-stp_10.42.42.5(pid=23575) [trial-2350↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23575)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23585): Process ended prematurely: osmo-stp_10.42.42.5(pid=23585) [trial-2350↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23585)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=23602): Process ended prematurely: osmo-stp_10.42.42.5(pid=23602) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23602)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=23614): Process ended prematurely: osmo-stp_10.42.42.5(pid=23614) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23614)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=23635): Process ended prematurely: osmo-stp_10.42.42.5(pid=23635) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23635)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23645): Process ended prematurely: osmo-stp_10.42.42.5(pid=23645) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23645)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23655): Process ended prematurely: osmo-stp_10.42.42.5(pid=23655) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23655)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=23672): Process ended prematurely: osmo-stp_10.42.42.5(pid=23672) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23672)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=23684): Process ended prematurely: osmo-stp_10.42.42.5(pid=23684) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23684)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=23702): Process ended prematurely: osmo-stp_10.42.42.5(pid=23702) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23702)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23712): Process ended prematurely: osmo-stp_10.42.42.5(pid=23712) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23712)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23722): Process ended prematurely: osmo-stp_10.42.42.5(pid=23722) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23722)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=23739): Process ended prematurely: osmo-stp_10.42.42.5(pid=23739) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23739)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=23751): Process ended prematurely: osmo-stp_10.42.42.5(pid=23751) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23751)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=23769): Process ended prematurely: osmo-stp_10.42.42.5(pid=23769) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23769)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23779): Process ended prematurely: osmo-stp_10.42.42.5(pid=23779) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23779)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=23789): Process ended prematurely: osmo-stp_10.42.42.5(pid=23789) [trial-2350↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23789)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23803): Process ended prematurely: osmo-stp_10.42.42.5(pid=23803) [trial-2350↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23803)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23816): Process ended prematurely: osmo-stp_10.42.42.5(pid=23816) [trial-2350↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23816)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=23829): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23829) [trial-2350↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23829)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=23840): Process ended prematurely: osmo-stp_10.42.42.5(pid=23840) [trial-2350↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23840)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=23849): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23849) [trial-2350↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23849)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=23859): Process ended prematurely: osmo-stp_10.42.42.5(pid=23859) [trial-2350↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23859)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23873): Process ended prematurely: osmo-stp_10.42.42.5(pid=23873) [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23873)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23884): Process ended prematurely: osmo-stp_10.42.42.5(pid=23884) [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23884)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23898): Process ended prematurely: osmo-stp_10.42.42.5(pid=23898) [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23898)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23909): Process ended prematurely: osmo-stp_10.42.42.5(pid=23909) [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23909)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23924): Process ended prematurely: osmo-stp_10.42.42.5(pid=23924) [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23924)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23935): Process ended prematurely: osmo-stp_10.42.42.5(pid=23935) [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23935)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23950): Process ended prematurely: osmo-stp_10.42.42.5(pid=23950) [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23950)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23961): Process ended prematurely: osmo-stp_10.42.42.5(pid=23961) [trial-2350↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23961)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23975): Process ended prematurely: osmo-stp_10.42.42.5(pid=23975) [trial-2350↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23975)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23986): Process ended prematurely: osmo-stp_10.42.42.5(pid=23986) [trial-2350↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23986)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24000): Process ended prematurely: osmo-stp_10.42.42.5(pid=24000) [trial-2350↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24000)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24011): Process ended prematurely: osmo-stp_10.42.42.5(pid=24011) [trial-2350↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24011)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=24030): Process ended prematurely: osmo-stp_10.42.42.5(pid=24030) [trial-2350↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24030)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=24042): Process ended prematurely: osmo-stp_10.42.42.5(pid=24042) [trial-2350↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24042)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=24060): Process ended prematurely: osmo-stp_10.42.42.5(pid=24060) [trial-2350↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24060)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24070): Process ended prematurely: osmo-stp_10.42.42.5(pid=24070) [trial-2350↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24070)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24080): Process ended prematurely: osmo-stp_10.42.42.5(pid=24080) [trial-2350↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24080)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=24097): Process ended prematurely: osmo-stp_10.42.42.5(pid=24097) [trial-2350↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24097)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=24111): Process ended prematurely: osmo-stp_10.42.42.5(pid=24111) [trial-2350↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24111)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=24129): Process ended prematurely: osmo-stp_10.42.42.5(pid=24129) [trial-2350↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24129)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24139): Process ended prematurely: osmo-stp_10.42.42.5(pid=24139) [trial-2350↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24139)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24149): Process ended prematurely: osmo-stp_10.42.42.5(pid=24149) [trial-2350↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24149)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=24166): Process ended prematurely: osmo-stp_10.42.42.5(pid=24166) [trial-2350↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24166)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=24181): Process ended prematurely: osmo-stp_10.42.42.5(pid=24181) [trial-2350↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24181)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=24199): Process ended prematurely: osmo-stp_10.42.42.5(pid=24199) [trial-2350↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24199)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24209): Process ended prematurely: osmo-stp_10.42.42.5(pid=24209) [trial-2350↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24209)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24224): Process ended prematurely: osmo-stp_10.42.42.5(pid=24224) [trial-2350↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24224)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=24237): Process ended prematurely: osmo-stp_10.42.42.5(pid=24237) [trial-2350↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24237)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24250): Process ended prematurely: osmo-stp_10.42.42.5(pid=24250) [trial-2350↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24250)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=24259): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24259) [trial-2350↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24259)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=24269): Process ended prematurely: osmo-stp_10.42.42.5(pid=24269) [trial-2350↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24269)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24284): Process ended prematurely: osmo-stp_10.42.42.5(pid=24284) [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24284)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24295): Process ended prematurely: osmo-stp_10.42.42.5(pid=24295) [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24295)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24309): Process ended prematurely: osmo-stp_10.42.42.5(pid=24309) [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24309)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24320): Process ended prematurely: osmo-stp_10.42.42.5(pid=24320) [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24320)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24334): Process ended prematurely: osmo-stp_10.42.42.5(pid=24334) [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24334)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24345): Process ended prematurely: osmo-stp_10.42.42.5(pid=24345) [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24345)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24359): Process ended prematurely: osmo-stp_10.42.42.5(pid=24359) [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24359)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24370): Process ended prematurely: osmo-stp_10.42.42.5(pid=24370) [trial-2350↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24370)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24384): Process ended prematurely: osmo-stp_10.42.42.5(pid=24384) [trial-2350↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24384)] FAIL: mo_mt_call_osmux.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=24532): Process ended prematurely: osmo-stp_10.42.42.5(pid=24532) [trial-2350↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24532)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=24682): Process ended prematurely: osmo-stp_10.42.42.5(pid=24682) [trial-2350↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24682)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24693): Process ended prematurely: osmo-stp_10.42.42.5(pid=24693) [trial-2350↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24693)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24707): Process ended prematurely: osmo-stp_10.42.42.5(pid=24707) [trial-2350↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24707)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24718): Process ended prematurely: osmo-stp_10.42.42.5(pid=24718) [trial-2350↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24718)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=24736): Process ended prematurely: osmo-stp_10.42.42.5(pid=24736) [trial-2350↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24736)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=24748): Process ended prematurely: osmo-stp_10.42.42.5(pid=24748) [trial-2350↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24748)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=24766): Process ended prematurely: osmo-stp_10.42.42.5(pid=24766) [trial-2350↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24766)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=24776): Process ended prematurely: osmo-stp_10.42.42.5(pid=24776) [trial-2350↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24776)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24786): Process ended prematurely: osmo-stp_10.42.42.5(pid=24786) [trial-2350↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24786)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=24807): Process ended prematurely: osmo-stp_10.42.42.5(pid=24807) [trial-2350↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24807)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=24819): Process ended prematurely: osmo-stp_10.42.42.5(pid=24819) [trial-2350↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24819)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=24837): Process ended prematurely: osmo-stp_10.42.42.5(pid=24837) [trial-2350↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24837)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=24847): Process ended prematurely: osmo-stp_10.42.42.5(pid=24847) [trial-2350↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24847)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24857): Process ended prematurely: osmo-stp_10.42.42.5(pid=24857) [trial-2350↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24857)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=24874): Process ended prematurely: osmo-stp_10.42.42.5(pid=24874) [trial-2350↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24874)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=24886): Process ended prematurely: osmo-stp_10.42.42.5(pid=24886) [trial-2350↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24886)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=24904): Process ended prematurely: osmo-stp_10.42.42.5(pid=24904) [trial-2350↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24904)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24915): Process ended prematurely: osmo-stp_10.42.42.5(pid=24915) [trial-2350↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24915)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24925): Process ended prematurely: osmo-stp_10.42.42.5(pid=24925) [trial-2350↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24925)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=24943): Process ended prematurely: osmo-stp_10.42.42.5(pid=24943) [trial-2350↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24943)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=24956): Process ended prematurely: osmo-stp_10.42.42.5(pid=24956) [trial-2350↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24956)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=24974): Process ended prematurely: osmo-stp_10.42.42.5(pid=24974) [trial-2350↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24974)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24989): Process ended prematurely: osmo-stp_10.42.42.5(pid=24989) [trial-2350↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24989)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24999): Process ended prematurely: osmo-stp_10.42.42.5(pid=24999) [trial-2350↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24999)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25012): Process ended prematurely: osmo-stp_10.42.42.5(pid=25012) [trial-2350↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25012)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.4 sec) Error: osmo-nitb_10.42.42.2(pid=25021): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25021) [trial-2350↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25021)] FAIL: esme_connect_policy_closed.py (2.0 sec) Error: osmo-nitb_10.42.42.2(pid=25023): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25023) [trial-2350↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25023)] FAIL: esme_ms_sms_storeforward.py (2.9 sec) Error: osmo-nitb_10.42.42.2(pid=25025): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25025) [trial-2350↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25025)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=25027): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25027) [trial-2350↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25027)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.7 sec) Error: osmo-hlr_10.42.42.2(pid=25036): Process ended prematurely: osmo-hlr_10.42.42.2(pid=25036) [trial-2350↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25036)] FAIL: esme_connect_policy_closed.py (5.9 sec) Error: osmo-hlr_10.42.42.2(pid=25047): Process ended prematurely: osmo-hlr_10.42.42.2(pid=25047) [trial-2350↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25047)] FAIL: esme_ms_sms_storeforward.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25059): Process ended prematurely: osmo-stp_10.42.42.5(pid=25059) [trial-2350↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25059)] FAIL: esme_ms_sms_transaction.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25070): Process ended prematurely: osmo-stp_10.42.42.5(pid=25070) [trial-2350↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25070)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25084): Process ended prematurely: osmo-stp_10.42.42.5(pid=25084) [trial-2350↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25084)] FAIL: register_a5_0_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25095): Process ended prematurely: osmo-stp_10.42.42.5(pid=25095) [trial-2350↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25095)] FAIL: register_a5_1_authreq.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25106): Process ended prematurely: osmo-stp_10.42.42.5(pid=25106) [trial-2350↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25106)] FAIL: register_a5_3_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25117): Process ended prematurely: osmo-stp_10.42.42.5(pid=25117) [trial-2350↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25117)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.2 sec) Error: srsepc(pid=25137): Process ended prematurely: srsepc(pid=25137) [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25137)] FAIL: iperf3_bidir.py (19.1 sec) Error: srsepc(pid=25156): Process ended prematurely: srsepc(pid=25156) [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25156)] FAIL: iperf3_dl.py (19.3 sec) Error: srsepc(pid=25172): Process ended prematurely: srsepc(pid=25172) [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25172)] FAIL: iperf3_ul.py (18.9 sec) Error: srsepc(pid=25188): Process ended prematurely: srsepc(pid=25188) [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25188)] FAIL: ping.py (18.3 sec) Error: srsepc(pid=25204): Process ended prematurely: srsepc(pid=25204) [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25204)] FAIL: rrc_idle_mo_ping.py (18.7 sec) Error: srsepc(pid=25220): Process ended prematurely: srsepc(pid=25220) [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25220)] FAIL: rrc_idle_mt_ping.py (18.4 sec) Error: srsepc(pid=25236): Process ended prematurely: srsepc(pid=25236) [trial-2350↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25236)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=25252): Process ended prematurely: osmo-stp_10.42.42.5(pid=25252) [trial-2350↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25252)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25268): Process ended prematurely: osmo-stp_10.42.42.5(pid=25268) [trial-2350↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25268)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25282): Process ended prematurely: osmo-stp_10.42.42.5(pid=25282) [trial-2350↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25282)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25296): Process ended prematurely: osmo-stp_10.42.42.5(pid=25296) [trial-2350↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25296)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25313): Process ended prematurely: osmo-stp_10.42.42.5(pid=25313) [trial-2350↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25313)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25327): Process ended prematurely: osmo-stp_10.42.42.5(pid=25327) [trial-2350↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25327)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25342): Process ended prematurely: osmo-stp_10.42.42.5(pid=25342) [trial-2350↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25342)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25356): Process ended prematurely: osmo-stp_10.42.42.5(pid=25356) [trial-2350↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25356)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25372): Process ended prematurely: osmo-stp_10.42.42.5(pid=25372) [trial-2350↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25372)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=25386): Process ended prematurely: osmo-stp_10.42.42.5(pid=25386) [trial-2350↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25386)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25400): Process ended prematurely: osmo-stp_10.42.42.5(pid=25400) [trial-2350↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25400)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25414): Process ended prematurely: osmo-stp_10.42.42.5(pid=25414) [trial-2350↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25414)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25428): Process ended prematurely: osmo-stp_10.42.42.5(pid=25428) [trial-2350↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25428)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25442): Process ended prematurely: osmo-stp_10.42.42.5(pid=25442) [trial-2350↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25442)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25456): Process ended prematurely: osmo-stp_10.42.42.5(pid=25456) [trial-2350↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25456)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25470): Process ended prematurely: osmo-stp_10.42.42.5(pid=25470) [trial-2350↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25470)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25487): Process ended prematurely: osmo-stp_10.42.42.5(pid=25487) [trial-2350↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25487)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25501): Process ended prematurely: osmo-stp_10.42.42.5(pid=25501) [trial-2350↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25501)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25515): Process ended prematurely: osmo-stp_10.42.42.5(pid=25515) [trial-2350↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25515)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25529): Process ended prematurely: osmo-stp_10.42.42.5(pid=25529) [trial-2350↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25529)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25543): Process ended prematurely: osmo-stp_10.42.42.5(pid=25543) [trial-2350↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25543)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25559): Process ended prematurely: osmo-stp_10.42.42.5(pid=25559) [trial-2350↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25559)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25573): Process ended prematurely: osmo-stp_10.42.42.5(pid=25573) [trial-2350↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25573)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25587): Process ended prematurely: osmo-stp_10.42.42.5(pid=25587) [trial-2350↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25587)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25601): Process ended prematurely: osmo-stp_10.42.42.5(pid=25601) [trial-2350↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25601)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25615): Process ended prematurely: osmo-stp_10.42.42.5(pid=25615) [trial-2350↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25615)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25629): Process ended prematurely: osmo-stp_10.42.42.5(pid=25629) [trial-2350↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25629)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25644): Process ended prematurely: osmo-stp_10.42.42.5(pid=25644) [trial-2350↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25644)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25658): Process ended prematurely: osmo-stp_10.42.42.5(pid=25658) [trial-2350↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25658)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25673): Process ended prematurely: osmo-stp_10.42.42.5(pid=25673) [trial-2350↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25673)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25687): Process ended prematurely: osmo-stp_10.42.42.5(pid=25687) [trial-2350↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25687)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=25701): Process ended prematurely: osmo-stp_10.42.42.5(pid=25701) [trial-2350↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25701)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=25987): Process ended prematurely: osmo-stp_10.42.42.5(pid=25987) [trial-2350↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25987)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=26001): Process ended prematurely: osmo-stp_10.42.42.5(pid=26001) [trial-2350↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26001)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26015): Process ended prematurely: osmo-stp_10.42.42.5(pid=26015) [trial-2350↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26015)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26029): Process ended prematurely: osmo-stp_10.42.42.5(pid=26029) [trial-2350↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26029)] + rm -rf trial-2350/inst + cd trial-2350 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-08 21:44:12 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350-run.tgz run.2022-12-08_21-44-24 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2350-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17648.tgz osmo-bts-oc2g.build-5528.tgz osmo-bts-sysmo.build-8032.tgz osmo-bts.build-7501.tgz osmo-ggsn.build-6676.tgz osmo-hlr.build-8695.tgz osmo-hnbgw.build-2940.tgz osmo-mgw.build-8940.tgz osmo-msc.build-29250.tgz osmo-nitb.build-12961.tgz osmo-pcu-oc2g.build-3905.tgz osmo-pcu-sysmo.build-5187.tgz osmo-pcu.build-5148.tgz osmo-sgsn.build-30027.tgz osmo-stp.build-9235.tgz osmo-trx.build-4672.tgz osmocom-bb.build-4692.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE